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1.  INTRODUCTION 

Effective  handoffs  of  care  are  critical  for  maintaining  safety  and  avoiding  communication  problems  in  acute  care. 
This  program  of  work  examined  the  entire  trauma  pathway,  to  include  multiple  handoff  types,  in  multiple  phases  of 
care,  and  exploring  multiple  dimensions  of  intervention.  We  have  taken  a  broad  approach  to  problem  definition  and 
early  analysis,  using  incident  reports,  observation  and  classification  of  flow  disruptions  along  the  trauma  pathway, 
process  mapping,  interviews  and  direct  observation.  We  have  found  the  most  important  factors  to  be  related  to  task 
and  teamwork,  and  have  been  able  to  demonstrate  redesigns  of  handoffs  to  provide  better  defined  processes  that  also 
improve  teamwork.  We  also  identified  situations  in  which  patients  can  deteriorate,  and  tested  a  secure  smartphone 
information  display  and  messaging  system,  that  employed  user-centered  design  to  improve  situational  awareness 
and  teamwork  in  a  simulated  trauma  setting. 

2.  KEYWORDS 

Human  Factors;  Handoffs;  Handover;  Communication;  Teamwork;  Trauma;  Cardiac  Surgery;  Patient  Safety; 
Improvement;  Systems  Analysis; 

3.  OVERALL  PROJECT  SUMMARY 

General  Introduction 

They  serve  several  purposes,  including  transfer  of  information,  transfer  of  responsibility,  identifying  deviations  from 
normal,  revealing  problems,  social  interaction,  distributing  knowledge,  and  reinforcing  values1.  Transitions  in 
trauma  care,  like  other  forms  of  handoffs,  are  vulnerable  to  systems  problems  and  human  errors.  This  project  took  a 
mixed-methods  approach  to  understanding,  modeling,  and  improving  handoffs  in  trauma  and  other  acute  care 
scenarios.  Developing  interventions  through  a  human-centered  model  of  care,  we  were  able  to  examine 
improvements  associated  with  technology,  training,  environment  and  task  redesign. 

This  program  of  work  examined  the  entire  trauma  pathway,  to  include  multiple  handoff  types,  in  multiple  phases  of 
care,  and  uses  multiple  dimensions  of  intervention.  12  studies  were  conducted,  grouped  into  categories  of  systems 
analysis  (4  studies),  pre  surgery  handoffs  (2  studies),  post  surgery  handoffs  (3  studies),  deterioration  (2  studies),  and 
technology  development  (1  study).  The  systems  analysis  developed  a  range  of  process  maps,  analyzed  clinician 
interviews,  explored  incidents  associated  with  handoffs,  and  flow  disruptions  in  handoffs  over  the  course  of  trauma 
care.  We  examined  pre  surgery  handoffs  from  the  Emergency  Department  (ED)  to  Imaging,  and  transfers  from  the 
ED  and  other  locations  into  the  Surgical  Intensive  Care  Unit  (SICU).  Post  surgery  handoffs  examined  were  the  Post 
Anesthetic  Care  Unit  (PACU),  the  Cardiac  Surgery  Intensive  Care  Unit  (CSICU),  and  in  Congenital  Heart 
Surgery(CHS).  Studies  in  deterioration  explored  the  relationship  between  mortality  and  changes  in  vital  signs  from 
EMS  to  ED  transfer,  and  the  parameters  that  predict  failure  to  rescue  deteriorating  patients.  Finally,  we  tested  and 
developed  a  smartphone  app  to  assist  in  communications,  handoffs,  teamwork  and  delivering  better  care. 

For  ease  of  reading,  this  section  summarizes  those  studies.  Later  sections  provide  more  detail  of  those  individual 
studies. The  challenge  was  how  to  appropriately  identify  opportunities  for  improvement,  to  test  them,  and  to  make 
such  innovations  sustain2"7. 
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EMS  Deterioration  Failure  to  Rescue:  Age,  Ventilation,  ICU,  Complications 
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Figure  1:  Summary  of  Studies  and  Interventions 


General  Methods 

The  complex  and  variable  nature  of  handoffs  required  several  different  approaches  to  data  collection. 
Fundamentally,  this  was  a  pseudo-ethnographic  research  and  quality  improvement  program,  with  the  research  team 
working  closely  (and  sometimes  within)  the  care  teams  to  understand  the  challenges  they  face  from  a  realist 
viewpoint.  Interventions  were  developed  with  the  input  and  assistance  of  the  care  teams,  and  implemented  using 
Plan-Do-Study- Act  (PDSA)  cycles8.  To  guide  the  research,  interviews  were  conducted  to  understand  the  challenges 
involved  in  handoffs,  their  purpose,  and  the  perceived  components  of  success.  We  also  analyzed  previously  reported 
incidents,  and  observed  some  of  our  own.  Trauma  databases  were  used  to  explore  the  role  of  handoffs  on 
deterioration  and  failure-to-rescue.  More  than  two  hundred  handoffs  of  different  types  were  studied  through  direct 
observation,  using  either  relatively  unstructured  qualitative  observations  of  flow  disruptions,  or  more  structured 
observations  of  technology,  information  and  teamwork.  Self  reporting  forms  were  used  where  we  could  not 
reasonably  conduct  observations.  Finally,  we  used  in  simulation  and  in  situ  simulation  to  evaluate  different 
approaches  to  handoffs,  using  video  observation  and  structured  debriefings  to  elicit  required  data.  The  areas,  studies 
and  methods  are  summarized  in  table  1 . 


Table  1:  Summary  of  Studies  and  Methods 


Pre-Arrival/  Arrival 

Pre  OR 

Post-Op  /  ICU 

Method 

Direct  Observation 
Database  Analysis 
Simulation 

Direct  Observation 

Direct  Observation 

Structured  Self  Report 
Environmental  Assessment 
Simulation 

Specific  Focus 

RN 

Charge  RN 

Doctors 

CT 

PACU 

SICU 

CSICU 

Process  Measures 

Pre-communication 
Handoff  Quality 
Unexpected  Events 

Flow  Disruptions 

Information 

Equipment 

Teamwork 

Interventions 

Smartphone  App 

CT  Checklist 

Process,  Environment,  Structured 
forms 

Outcome  Measures 

Simulation 

performance 

Duration 

Teamwork 

Preparation 

Orders 

Equipment  configuration 

Information  handoff 

Teamwork 
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General  Findings 

The  key  research  accomplishments  are: 

•  Detailed  mapping  of  handoffs  along  the  trauma  pathway  and  other  high-risk  analogue  handoffs  within  a 
hospital,  revealing  a  complex  handoff  ecosystem"  and  a  structure  up[on  which  to  define  handoff  properties 
and  designs. 

•  An  analysis  of  the  disruptions  during  transitions  and  handoffs  along  the  trauma  pathway  showing  that: 

o  Many  patients  experience  some  disruption  during  care  transition 
o  Co-ordination  problems  are  dominant  causes 
o  The  sicker,  more  at  risk  patient  experience  more  problems. 

•  An  analysis  of  hospital  incident  reports  of  handoffs,  revealing  that  task  and  teamwork  causes  are  dominant 

•  The  deployment  of  observational  methods  to  measure  specific  types  of  handoffs  and  transitions,  exploring 
the  relationship  between  task  and  teamwork. 

•  A  statistical  model  of  the  relationship  between  tasks,  teamwork  and  process  in  transitions  from  OR  to 
PACU  and  ICU. 

•  Measurement  of  the  reliability  of  handoffs  to  surgical  ICU. 

•  Development  and  evaluation  of  three  interventions  that  validate  this  approach 

•  Development  of  a  teamwork  and  communication  app  to  improve  handoffs,  information  provision  and 
teamwork  across  the  trauma  pathway  and  beyond. 

General  Discussion 

Our  analysis  of  flow  disruptions,  process  maps,  and  direct  observations  suggest  that  it  is  the  high  risk,  less  frequent 
handoffs  that  created  the  greatest  problems.  Handoffs  to  ICU  involve  an  entire  change  in  care  team,  happen  with  the 
sickest  patients,  and  are  relatively  unstructured.  In  terms  of  improvement,  process  and  teamwork  improvements 
offer  the  best  solution,  as  indicated  by  interviews,  flow  disruption  analysis,  and  direct  observation  of  interactions 
between  teamwork  and  process. 

As  a  model  of  high  acuity  handoffs  and  direct  admissions  to  ICU,  we  focused  interventions  on  cardiac  patients 
transferring  from  the  OR.  Working  within  the  CSICU  allowed  us  to  observe  with  reliable  frequency  these  types  of 
handoffs.  By  expanding  the  concept  of  handoff  from  the  traditional  mnemonic  (e.g.  SBAR),  to  incorporated  process 
redesign,  checklists,  teamwork,  and  training,  we  demonstrated  that  encouraging  the  optimal  task,  team  and 
technology  interactions  will  produce  measureable  improvements  in  the  handoff  process. 

General  Conclusions 

Phase  II  of  the  Operating  Room  of  the  Future  program  has  built  a  unique  set  of  knowledge  around  handoffs  in  high 
risk  patients.  We  have  taken  a  broad  approach  to  problem  definition  and  early  analysis,  using  incident  reports, 
observation  and  classification  of  flow  disruptions  along  the  trauma  pathway,  process  mapping,  interviews  and  direct 
observation.  We  have  found  the  most  important  factors  to  be  related  to  task  and  teamwork,  and  have  been  able  to 
demonstrate  redesigns  of  handoffs  to  provide  better  defined  processes  that  also  improve  teamwork.  We  also 
identified  situations  in  which  patients  can  deteriorate,  and  tested  a  secure  smartphone  information  display  and 
messaging  system,  that  employed  user-centered  design  to  improve  situational  awareness  and  teamworkin  a 
simulated  trauma  setting. 
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Systems  Analysis 

Introduction 

A  range  of  models  exist  for  describing  the  complex  relationship  between  systems  components9,10  but  generally  they 
acknowledge  that  people;  tasks;  equipment;  tools  and  aspects  of  the  organization  all  interact  to  produce  either 
successful  or  unsuccessful  processes  and  outcomes.  In  order  to  understand  the  different  types  of  handoff  and  the 
context  in  which  those  handoffs  happen,  we  first  examined  the  systems  of  work  in  which  these  handoffs  are 
embedded.  This  required  a  mapping  of  the  process,  interviews  with  staff,  analysis  of  incidents  associated  with 
handoffs,  and  direct  observation  and  analysis  of  flow  disruptions. 

Study  1:  Process  Mapping 

Through  detailed  considerations,  patient  shadowing,  and  discussing  the  process  with  clinicians  in  different  parts  of 
the  hospital,  we  investigated  how  patients  move  around  the  hospital,  which  identified  areas  and  methods  for 
subsequent  detailed  study  of  specific  handoffs.  Our  observations  and  assessments  considered  six  key  areas  of  the 
handoff  process,  of  which  1  -4  were  eventually  studied. 

1 .  Emergency  Department  (ED)  to  Imaging  (CT) 

2.  Admission  to  the  Surgical  Intensive  Care  Unit  (SICU) 

3.  Operating  Room  (OR)  to  the  Post  Anesthesia  Care  Unit  (PACU) 

4.  OR  to  the  Cardiac  Surgical  Intensive  Care  Unit  (CSICU) 

5.  Step-down  Handoffs  from  ICU  to  Ward 

6.  Shift-to-shift  handoffs 

A  further  mapping  process  also  allowed  us  to  superimpose  human-centered  considerations  that  typify  each  different 
handoff.  Considering  the  function  of  each  handoff,  there  were  three  types. 

•  Type  1 :  Care  Process  Handoff.  Required:  decision  making,  resource  management  and  co-ordination 

•  Type  2:  Team  Transfer  Handoff.  Required:  equipment  transfer,  teamwork  processes,  information  handoff 

•  Type  3:  Care  Continuity  Handoff:  Required:maintainsituation  awareness  and  shared  decision  making 

Type  1  handoffs  -  typified  by  decision  making  in  the  ED  and  CT  -  are  moments  at  which  the  care  of  the  patient  and 
their  treatment  pathway  change  rapidly,  based  on  the  use  of  dynamic  changing  resources,  and  requiring  the  team 
(some  of  whom  may  be  new  to  that  patient)  to  agree  on  a  decision  and  co-ordinate  the  response  to  ensure  the 
appropriate  follow-through.  Type  2  handoffs  -  typified  by  transfers  from  surgery  -  are  where  the  transfer  of  the 
patient  is  both  physical  and  between  teams,  requiring  continuity  of  information  and  care  between  the  teams.  With 
these  handoffs,  the  care  pathway  should  be  clear,  and  the  patient  relatively  stable,  so  the  dynamic  decision  making 
component  is  not  required,  and  can  be  more  easily  structured.  Type  2  handoffs  are  where  we  hypothesize  will  be  the 
greatest  need  for  precise  information  transfer  to  better  identify  deteriorating  patients.  Type  3  handoffs  -  typified  by 
within-unit  handoffs  -  require  the  maintenance  of  patient  care  over  a  longer  period,  requiring  the  continual  updating 
of  patient  information  and  strategic  shared  decision  making  to  move  the  patient  through  their  care  to  discharge.  All 
three  handoffs  are  qualitatively  different,  and  so  have  different  requirements.  Finally,  we  mapped  in  detail  processes 
for  the  ED  to  Imaging  transfer  process  (figure  4),  admission  to  ICU  (figure  5),  and  for  step-down  from  ICU  to  ward 
care  (figure  6).  All  three  processes  are  typified  by  a  non-linear  sequence  of  multiple  communications,  largely  by 
telephone,  prior  to  the  physical  movement  of  the  patient. 
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Figure  2:  Handoffs  and  Information  Flow  along  the  Trauma  Care  Pathway 
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Figure  4:  Process  for  transfer  of patient  from  ED  to  Imaging 
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Figure  5:  Process  for  admission  of patient  from  the  OR  to  ICU 
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Study  2:  Interviews 

In  order  to  understand  from  the  provider  point  of  view  those  generic  skills  and  system  configurations  that 
differentiate  between  good  and  bad  handoffs,  semi- structured  interviews  were  conducted  with  staff  For  this  we 
worked  with  Madigan  Army  Medical  Center,  where  a  series  of  interview  and  focus  groups  were  conducted  with  a 
total  of  113  staff  (15  ICU  Nurses,  Attendings&  Residents;  3  respiratory  technicians;  34  anesthesia  providers;  4 
blood  bank  staff;  8  ED  staff;  8  general  surgery  residents,  and  40  OR  staff).  We  recorded  67  individual  comments 
and  perspectives  that  were  then  classed  into  several  categories.  First,  we  considered  the  reported  purposes  of  handoff 
that  featured  in  the  comments.  Next,  the  process  considerations,  and  finally,  we  classified  comments  according  to 
the  SEIPS  model  of  human  factors  (Figure  7). 

Overall,  we  found  that  a  good  handoff  is  defined  by  the  transfer  of  information,  responsibility,  and  the  shared 
planning  of  future  care.  This  is  influenced  by:  clear  leadership  &  role  definition,  face-to-face  communication,  and  a 
standard  template  and  process  to  follow.  We  concluded  that  an  improved  handoff  process  could  include 

•  Face  to  face  handoffs  with  both  physicians  and  nurses 

•  Structured  process:  including  notification  of  patient  prior  to  arrival,  standardized  information  handoff, 
agree  a  plan  for  ongoing  care 

•  Training,  role  definition,  clear  transfer  of  accountability 

•  Technologies  -  computer  systems,  whiteboard,  paper 

This  supported  our  underlying  hypothesis  that  handoffs  have  a  range  of  systems  components  allowing  improvements 
on  several  dimensions. 


Figure  7:  Results  from  provider  interviews 
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Study  3:  Incident  Analysis 

To  understand  more  about  injuries  relating  to  handoffs,  we  analyzed  19  hospital  incidents  associated  with  handoffs 
(figure  8).  These  data  were  accessed  via  MIDAS,  the  patient  safety  incident  reporting  system  at  Cedars-Sinai.  Of  the 
54  handoff  defects  indentified,  52%  were  attributed  evenly  to  either  team  or  task  (14  in  each  category).  Though  care 
needs  to  be  taken  with  hindsight  bias  when  examining  these  data,  this  provided  further  weight  to  our  approach  of 
measuring  process,  teamwork  and  information  flow  in  handoffs. 


Han  doff  Variables/Defects 


■  Caregiver 


■  Instituational 


■  Technical 


■  Patient 


■  Team 


■  Task 


Figure  8:  Results  of  incident  database  analysis 

During  our  research,  we  had  the  opportunity  to  observe  a  sequence  of  failures  in  handoff  from  ED  to  ICU  that 
further  illustrated  how  minor  incidents  occur  and  how  they  might  escalate  to  more  serious  situations: 

•  A  72  year  old  demented  patient  in  the  ED  required  major  emergent  surgery  that  would  typically  require  a 
direct  ICU  admission  post  op 

•  Intraoperative  discussion  between  anesthesia,  surgery  and  nursing  suggested  that  the  patient  required 
minimal  operative  repair  and  therefore  was  going  to  need  an  ICU  bed  but  could  recover  in  the  PACU 

•  The  PACU  notified  the  ICU  charge  nurse  that  a  patient  who  was  presently  in  the  OR  needed  to  be  admitted 
directly  to  the  ICU  based  upon  the  assumed  case 

•  The  ICU  charge  RN  asked  that  bed  reservation  be  called  so  a  bed  can  be  assigned  to  the  patient,  and  then  to 
call  back  as  is  standard  procedure. 

•  The  anesthesiologist  communicated  with  the  ICU  MD  via  a  phone  call  providing  the  patient'*  *s  name  and 
suggested  that  more  information  would  be  provided  at  the  end  of  the  case. 

•  Patient  was  extubated  post-op  as  the  surgery  was  less  extensive  than  expected 

•  The  patient  was  transported  to  the  PACU  as  per  anesthesia  and  surgery"s  request  but  then  diverted  to  the 
SICU  based  on  preoperative  planning 

•  The  patient  arrived  in  the  ICU  with  no  updated  handoff  between  the  MDs  or  the  RNs.  The  charge  nurse  and 
accepting  nurse  were  at  the  bedside  to  evaluate  the  patient  and  receive  a  report.  However,  the  transferring 
PACU  RN  stated  that  she  knew  ,pothing"  about  the  patient. 

•  The  accepting  nurse  assessed  the  patient,  noted  that  he  appeared  altered  and  in  respiratory  distress  and 
immediately  informed  the  ICU  MD  who  came  to  the  bedside. 

•  The  ICU  immediately  intubated  the  patient  although  his  unidentified  baseline  dimension  likely  contributed 
to  the  respiratory  distress. 
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Figure  9:  Failures  in  handoff  process  during  one  incident. 


Study  4:  Flow  Disruption  Analysis 

The  direct  observation  of  process  failures  provides  a  valuable  perspective  on  the  mismatches  between  system  and 
human,  intent  and  action.  Flow  disruptions  are  intraoperative  problems  that  cause  deviations  from  the  optimal  course 
of  care  and  provide  the  identification  of  a  broad  range  of  system  problems.  The  detailed  behavioral  analysis  this  data 
affords  lends  itself  to  substantial  post-hoc  analysis  that  allows  feedback  and  system  improvement.  The  significance 
of  flow  disruptions  lies  in  their  ability  to  provide  a  hitherto  unavailable  perspective  on  the  quality  and  efficiency  of 
the  system11.  Observational  studies  focusing  on  flow  disruptions  allow  for  a  systematic,  quantitative  and  replicable 
assessment  of  the  relations  between  the  surgical  environment,  processes  and  outcomes12. In  phase  one,  we  found  that 
flow  disruptions  for  trauma  patients  occurred  at  a  rate  of  approximately  9  per  hour,  with  coordination  and 
communication  issues  accounting  for  over  half  the  flow  disruptions13.  We  used  this  flow  disruption  data  to 
understand  more  about  care  transitions  and  handoffs  during  initial  trauma  care. 

A  total  of  160  patients  were  studied,  and  a  total  of  351  care  transitions  were  observed  (mean  2.2±  0.09  per  patient). 
Of  these  patients,  68  (42.5%)  experienced  at  least  one  disrupted  transition  during  their  care,  with  a  mean  of  0.66  ± 
0.15  flow  disruptions  per  patient  and  0.31  ±  0.07  flow  disruptions  per  transition.  We  used  this  flow  disruption  data 
to  examine  where  patients  most  frequently  transition  from  and  to,  and  the  flow  disruptions  associated  with  those 
transitions.  Examples  of  flow  disruptions  in  handoffs  included: 

•  Transport  monitor  had  no  charge 

•  Elevator  went  down  instead  of  up  on  the  way  to  the  surgical  suite  from  the  preop  area. 

•  Team  had  to  wait  in  hallway  because  CT  wasn't  ready 

•  Began  transport  without  the  nurse.  Had  to  stop  and  wait  in  the  hall  and  wait  for  the  nurse  to  catch  up. 

•  Bed  hit  another  bed  in  the  congested  hallway 

•  Resident  forgot  to  bring  documentation,  and  there  was  a  delay  while  they  turned  around  to  get  it 


W81XWH-1 1-1-0813 


Page  14  of  77 

Mapping  the  transitions  of  care  by  patient  (figure  10)  shows  that  81.8%  of  patients  were  assessed  and  transferred  to 
imaging  for  further  diagnostics,  with  72.4%  of  patients  arriving  back  in  the  ED  following  imaging  assessment  to 
await  further  consultation  or  discharge  assessment.  9.4%  of  patients  return  to  the  ED  and  then  are  transferred  to  the 
ICU  or  OR.  Sicker,  time -pressured,  and  more  at  risk  patients  are  more  likely  to  experience  problems.  Thus, 
reducing  the  number  of  transitions  and  improving  co-ordination  in  transitions  along  the  trauma  pathway  may  reduce 
risks  and  improve  efficiency. 

The  majority  of  flow  disruptions  in  this  study  (53%)  were  related  to  coordination  problems  (figure  11),  such  as 
where  CT  was  already  occupied;  the  nurses  in  pre-op  did  not  have  the  correct  paperwork;  the  patient  was  taken  to 
the  wrong  room;  or  critical  team  members  were  missing  when  needed.  There  is  a  small  additive  effect  where 
multiple  transitions  equate  to  a  higher  number  of  flow  disruption  transitions  per  patient  and  the  number  of  flow 
disruptions  per  transition  reduces  slightly  as  patients  experience  one,  two  or  three  transitions.  The  data  also 
demonstrates  “high  risk”  and  “low  risk”  patient  experiences.  Whenever  a  patient  goes  directly  to  the  OR,  or  when  a 
patient  needs  immediate  admission  to  ICU,  there  is  a  higher  risk  of  transition  disruptions  than  when  they  go  to  the 
floor,  discharge,  or  a  holding  area  having  first  been  to  CT.  In  high  risk  transitions  40%  of  patients  experience  two  or 
more  transition  flow  disruptions  during  their  care,  as  opposed  to  13%  for  the  low  risk  transition  patients.  It  is  the 
sicker,  more  urgent  patients  who  are  more  likely  to  experience  these  non-standard  transitions,  and  in  doing  so 
experience  more  flow  disruptions. 


TRANSITION  1 


TRANSITION  2 


TRANSITION  3 


2.2% 


7.2% 


15.5% 


Figure  10:  Observed  flow  disruptions  during  trauma  care  transitions14 . 
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Figure  11:  Flow  disruptions  in  trauma  care  transitions 


Discussion 

This  process  demonstrated  a  number  of  key  issues  that  helped  focus  our  subsequent  work.  First,  patients  move 
frequently  and  rapidly  between  care  teams  and  locations.  These  movements  are  a  complex  orchestration  of  people, 
equipment  information  and  organization.  Transfers  involve  multiple  phone  calls,  face  to  face  communications,  IT 
systems,  forms,  and  people  of  different  specialties.  These  processes  are  regularly  problematic,  which  can  create 
more  serious  situations,  especially  for  sicker  or  more  high  risk  patients  who  need  to  be  transferred  faster  and  with 
less  problems. Handoffs  take  many  forms  and  serve  different  purposes.  They  are  the  transfer  of  responsibility  and 
information,  the  closure  of  old  plans  and  the  instigation  of  new  plans.  They  may  require  physical  movement  of 
patients  and  equipment,  and  they  may  require  the  transfer  of  responsibility  to  a  new  team.  They  may  require  both  at 
once.  This  confirmed  that  handoffs  have  a  range  of  systemic  components  that  might  influence  performance.  Good 
teamwork  in  particular  is  the  key  to  a  good  handoff,  but  teamwork  exists  within  a  complex  organizational, 
professional  and  socio-cultural  environment.  It  also  illustrated  how  handoff  is  not  necessarily  a  one-off  information 
transfer  but  a  dynamic  part  of  ongoing  care.  The  effects  of  a  poor  handoff  might  be  felt  hours,  days  or  possibly 
weeks  afterwards. 

These  differences  between  handoff  types  required  handoff-specific  measurement  strategies.  In  essence,  it  was 
necessary  to  develop  a  different  way  to  assess  each  handoff.  Some  handoffs  are  regular,  predictable  and  frequent. 
Others  are  irregular,  variable  and  infrequent.  Some  can  be  understood  through  unobtrusive  direct  observation  of 
face-to-face  interactions.  Others  happen  asynchronously  or  over  the  telephone  (requiring  an  invasive  observation 
method).  Our  subsequent  approach  therefore  explored  several  of  the  highest  risk  areas  of  handoffs.  Patients  are 
transferred  to  and  from  the  imaging  facility  frequently,  so  these  transitions  needed  to  be  studied  in  more  detail. 
However,  they  are  perhaps  the  least  risky,  with  transfers  between  ED  and  ICU  higher  risk  and  still  relatively 
frequent,  and  transfers  from  OR  to  ICU  less  frequent,  but  of  higher  complexity  and  higher  risk.  First,  we  explored 
pre-surgery  handoffs,  based  on  the  findings  from  our  flow  disruption  analysis.  We  examined  issues  in  the  transfer  of 
trauma  patients  from  ED  to  imaging  and  from  trauma  service  to  ICU.  Next,  we  explored  post-surgery  handoffs  from 
OR  to  PACU/ICU  in  high-risk  surgeries.  We  were  not  confident  of  achieving  a  high  sample  size  in  trauma  care,  so 
elected  to  study  cardiac  surgery,  which  is  amongst  the  highest  risk  of  all  surgeries.  Finally,  we  explored  handoffs 
and  deterioration  in  pre-arrival  care  and  subsequently  across  the  course  of  the  care  delivered. 
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Pre-Surgery  Handoffs 

Introduction 

The  initial  systems  analysis  provided  two  pre-surgery  areas  for  handoff.  The  first  was  in  examining  the  transfer  of 
patients  from  ED  to  the  ICU.  This  had  been  identified  as  potentially  high  risk  handoff  in  the  interviews,  confirmed 
in  the  flow  disruption  and  incident  analysis.  As  a  Type  two  handoff(physical  and  team  transition),  this  automatically 
made  it  potentially  risky.  However,  given  the  irregularity  of  this  type  of  transfer,  we  needed  to  consider  a  method 
other  than  direct  observation  for  the  assessment  of  the  handoff. 

The  other  area  for  focus  was  in  the  transfer  from  ED  to  imaging,  which  was  relatively  low  risk  Type  one  handoff  (a 
change  in  location  but  not  care  team),  was  experienced  by  four  fifths  of  trauma  patients.  However,  the  flow 
disruption  analysis  had  shown  it  to  be  problematic,  and  there  was  already  considerable  previous  data15,16  exploring 
problems  in  imaging.  This  generated  the  hypothesis  that  improvements  might  be  possible  with  a  checklist 
intervention.  For  trauma  care,  these  handoffs  are  critical,  since  they  will  be  the  first  change  in  the  care  team.  Thus, 
the  transfer  of  patient,  equipment  and  critical  care  information  for  these  patients  from  one  team  to  the  next  is  a 
particularly  important  part  of  care. 

Study  5:  Transfers  to  the  Surgical  Intensive  Care  Unit 

This  study  examined  the  process  of  informing  about  arrival  of  the  patient;  the  handoff  itself;  and  later  effects.  Since 
these  handoffs  are  irregular  to  identify  and  thus  challenging  to  observe,  we  adopted  a  self-report  methodology. 
Though  reliant  on  perceptions,  it  has  generated  valuable  data  upon  which  it  will  be  possible  to  generate  steps  toward 
an  intervention. 

The  data  was  gathered  at  three  levels  in  the  SICU:  the  receiving  nurse,  the  charge  nurse,  and  the  resident  physician. 
The  full  data  collection  sheet  can  be  found  in  Appendix  3,  and  consisted  of  a  series  of  questions  exploring  pre- 
operative  communications,  the  completeness  of  the  handoff  (and  the  items  handed  off)  and  whether  subsequently 
patients  had  been  sicker  than  expected.  Forms  were  distributed  to  the  team  following  an  introduction  at  a  weekly 
unit  meeting,  with  a  surgical  resident  and  research  nurse  following  up  to  ensure  that  the  reports  had  been  completed 
successfully. 

From  the  RN  data  we  received  74  self  reports.  In  93%  of  cases  the  communication  prior  to  patient  arrival  was  timely 
and  appropriate.  For  the  handoff  itself,  in  85%  of  cases  the  report  was  felt  to  be  complete,  with  92%  +/-  4%  of  13 
information  items  reliably  reported  (Figure  12).  However,  in  one  case  only  the  patienfs  name  was  reported.  In 
another,  the  wrong  dosage  was  indicated.From  the  charge  nurse  data,  a  total  of  68  handoffs  were  reported.  For  those, 
in  about  one-quarter  of  patients  (26%)  there  was  no  communication  between  charge  nurse  and  doctor.  The 
admission  process  from  the  ED  would  appear  tobe  the  least  reliable  (figure  13).  34%  of  patients  were  reported  as 
sicker  than  expected,  and  in  1 8%  of  patients  something  unexpected  happened.  While  this  may  not  directly  indicate 
flaws  in  the  system,  it  suggests  that  expectations  (or  situation  awareness)  might  be  significantly  reduced  in  these 
cases.Finally,  of  the  79  physician  handoff  self  reports, 68%  of  physicians  felt  that  patient  acceptance  to  the  unit  had 
been  properly  communicated.  16%  patients  were  admitted  where  ICU  admission  was  felt  to  be  inappropriate,  with 
handoffs  inappropriate  in  12%  of  cases.  In  comparison  with  the  charge  nurse,  9%  patients  were  sicker  than  expected, 
and  5%  had  unexpected  events  associated  with  their  care. 
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Figure  12:  Information  handoffs  (SICU  Nurse) 


OR/PACU  ED  Floor  Others 


Figure  13:  Charge  nurse  self  reports 
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Study  6:  Improving  ED  to  Imaging  Transfer  with  a  Checklist 

A  checklist  was  developed  for  improving  patients  admission  into  CT.  This  is  based  on  concerns  information,  team 
and  process  during  transition  to  CT,  and  especially  in  ensuring  appropriate  preparedness  for  CT  scanning.  81%  of 
trauma  patients  visit  the  CT  scanner.  We  had  found  that  this  transfer  process  was  fraught,  and  created  many  delays, 
especially  in  coordinating  the  team  and  the  complex  components  required  for  this  task.  For  example,  we  found  that 
some  patients  can  be  delayed  in  the  corridor  waiting  for  the  scanner  to  become  available;  and  some  are  not 
appropriately  prepared  early  for  the  removal  of  metal  objects  (especially  earrings)  from  their  person.  We  also  found 
flow  disruptions  in  CT  due  to  patients  who  move  and  we  may  be  able  to  more  adequately  prepare  for  them  for  their 
time  in  scanning.  We  thusinstigated  a  CT  checklist  to  aid  in  the  transfer  of  patients  from  ED  to  CT  (figure  14). 


Trauma  — 

CT  Checklist 

□  CT  notified? 

□  Orders  in?  Orders  correct? 

A:  Airway 

□  Oxygen  tank  with  sufficient  02? 

B:  Blood 

□  Should  you  transport  with  blood? 

C :  CT  ready 

Cardiac  monitor 

□  Jewelry  removed? 

□  CT  ready?  Which  scanner? 

□  Is  the  patient  on  a  monitor? 

D:  Drugs 

□  Necessary  drugs  available 
(FentanvL  versed,  propofol  antiemetics') 

E:  Exit 

Consider  where  patient  will  you  go  after  CT 
□  ICU  admission?  Request  bed.  Complete 
check  out  in  scanner. 

Figure  14:  CT  Imaging  Checklist 


Observers  waited  in  the  ED,  and  responded  immediately  to  the  trauma  pager,  going  directly  to  the  trauma  bay  to 
observe  the  team,  according  to  a  structured  observation  process  (Appendix  3).  The  process  was  evaluated  by  adding 
up  the  number  of  tasks  completed  before  and  after  arrival  in  CT  from  the  key  list  of  required  tasks  (Patient  on 
monitor;  transport  bag  present;  additional  pain  meds  available;  CT  orders  entered;  metallic  items  removed;  arm  band 
placed;  scanner  assigned).  Teamwork  was  measured  on  a  scale  of  1-5  for  6  dimensions  (Leadership,  Cooperation, 
Communication,  Assessment,  Situation  Awareness).  Finally,  time  data  were  also  measured  at  different  points  in  the 
process. 

41  cases  were  studied.  We  measured  a  significant  improvement  in  process  (p=0.02),  and  teamwork  (p=0.0001),  but 
with  an  increase  in  the  preparation  time  in  CT  (p=0.024).  This  can  be  seen  in  figure  15.  Despite  positive  these 
positive  results,  the  CT  checklist  was  not  sustained  after  the  research  team  left.  However,  following  an  incident 
where  a  patienf's  airway  was  not  fully  secured,  which  may  have  contributed  to  deterioration  and  other 
complications,  the  concept  was  re-instituted  with  a  new  and  simplified  version  of  the  checklist  (figure  1 6) 
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■  With  Checklist 


■  Without  Checklist 
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Patient  Label 

(DRAFT)  Jan  2.  2014 

ED/Trauma  CT  Safety  Communication  Check  List 

CT: 

□  Is  CT  scanner  ready? 

□  Have  orders  been  placed  for  planned  imaging  studies? 

Blood/Fluids/Access: 

□  Does  patient  have  adequate  IV  access? 

EH  Does  patient  need  additional  IVF/blood  for  use  in  CT? 

Airway: 

EH  Is  airway  patent? 

Meds:  Sedation/analgesics/antiemetics: 

EH  Does  patient  need  sedation/analgesics/antiemetics  at  this  time? 

EH  What  meds  do  we  anticipate  needing  in  CT? 

ED  RN  Scribe/Leader  _ 

Trauma  Chief  _ 


This  form  is  part  of  a  Quality  Improvement  project  aimed  at  improving  safetyduring  transport  of  Trauma 
patients  to  and  from  CT.  The  component  are  to  called  out  and  the  form  is  to  be  signed  by  the  primary 
Trauma  nurse  and  Trauma  Chief prior  to  the  patient  leaving  the  ED  for  CT,  attesting  that  the  components 
of  the  check  list  were  discussed  and  agreed  to.  All  members  of  the  treatment  team  are  encouraged  to 
voice  their  concerns  over  patient  safety  before  and  during  transport. 


Figure  16:  ED  to  CT  Transfer  Checklist  Version  2 
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Discussion 

The  pre-surgery  handoffs  studied  were  typified  by  physical  patient  movement,  with  (admission  to  ICU)  or  without 
(ED  to  Imaging)  a  transfer  of  responsibility.  We  found  that  for  both  types  of  handoffs  there  was  a  perception  that 
handoffs  were  generally  effective,  with  some  small  defects.  In  our  observations  and  measurements,  we  found 
inconsistencies  and  weaknesses  that  individually  were  inconsequential,  but  that  were  observed  to  have  down-stream 
impact  on  teamwork,  communication  and  quality  of  care.  In  both,  we  also  noted  instanced  were  these  otherwise 
minor  or  innocuous  problems  had  concatenated  to  acutely  threaten  patient  safety. 

For  the  ICU,  treatment  details  are  sometimes  omitted  from  nurse  reports,  while  the  charge  nurses  found  up  to  one 
third  of  patients  are  sicker  than  expected,  while  one  in  ten  physicians  find  something  similar.  For  CT,  several  items 
improved  performance,  and  the  subsequent  re-introduction  of  the  checklist  following  a  serious  event  emphasized 
this.  Experimentally,  we  established  the  relationship  between  teamwork,  technology  and  process.  Interventions  are 
possible,  but  can  be  challenging  if  the  perception  is  otherwise  positive.  When  an  opportunity  for  improvement 
arises,  working  with  the  ED  and  trauma  teams  it  was  possible  to  redesigned  the  process  several  times.  As  has  been 
found  before,  sustainability  is  the  fundamental  challenge. 

In  the  next  set  of  studies  we  focused  on  clinical  areas  that  did  recognize  improvements  were  needed,  and  later  we 
explored  the  potential  for  information  technology  implementations  to  assist  in  sustainability. 
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Post-Surgery  Handoffs 

Introduction 

Handoffs  from  surgery  to  ICU  are  some  of  the  most  critical  in  the  hospital.  Patients  are  frequently  unstable  -  or  at 
least  have  some  risk  of  instability  following  their  operation  -  are  usually  receiving  a  number  of  medications,  are 
frequently  on  other  means  of  life  support,  and  are  usually  semi-  or  unconscious.  These  handoffs  constitute  a  entire 
change  in  care  team  from  one  that  has  spent  at  least  several  hours  with  the  patient  (the  surgical  team)  to  the  post- 
surgical  or  ICU  teams  who  have  never  before  seen  that  patient.  Even  the  physical  transfer  of  the  patient  carries  risks. 

Previous  studies  in  post-surgery  handoffs  describe  four  stages: 

1.  Pre  handoff  (before  the  patient  arrives).  It  is  important  to  know  when  the  patient  going  to  arrive?  (<30 
mins  and  >2  mins  warning),  what  sort  of  condition  will  they  be  in,  and  how  to  set  up  the  room  (vent 
settings,  pumps,  drips,  lines,  support  technology). 

2.  Technology  transfer.  Sick,  complex  patients  require  complex  equipment,  monitoring,  drugs  and  other 
technological  support.  Technology  needs  to  be  configured  swiftly  and  reliably.  The  technology  in  a 
handoff  from  the  cardiac  surgery  OR  is  usually:  Ventilator,  BIS  &  Cables,  Urimeter,  Bair  Hugger,  IV  Pole 
+  C-clamp,  3x  suction  (vent,  chest,  gastric),  6x  Monitor  Cables  (EKG,  Sats,  BP,  3x  pressure  monitoring 
cables),  3x  Garbage  (Regular,  bio  material,  pharmacy  waste).  Occasional  additions  include:  CCO  SWAN 
Catheter  monitor  and  cable,  LA  pressure  line  cable,  Extra  infusion  pump,  Ventricular  Assist  Devices. 

3.  Information  handoff.  The  information  handoff  is  perhaps  the  most  critical  component,  and  is  largely 
unstructured.  SBAR,  a  popular  handoff  mnemonic,  is  not  sufficient  to  guide  the  complexity  of  information 
for  these  patients.  We  need  to  consider  who  hands  over  information  and  when,  what  information  is  really 
important  (patient  details,  surgical  procedure),  what  can  be  obtained  from  the  IT  systems  and  what  needs 
to  be  transferred  verbally. 

4.  Discussion  and  Plan.  The  final  component  to  strengthen  the  process  is  to  discuss  and  agree  a  plan  for  the 
care  of  the  patient  and  established  a  shared  mental  model  of  the  next  stages  of  care. This  should  involve  at 
least  one  OR  physician  and  one  ICU  physician  and  nurse,  but  preferably  all.  We  need  to  consider  what 
should  be  discussed?  (E.g.  Bloods/  fluids/  pain/  antibiotics/  feeding/  lines/  drains/  monitoring),  and  what 
contingencies  to  plan  for  (E.g.  monitoring,  extubation,  expectation). 
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Figure  1 7:  Handoff  process  from  OR  to  ICU 
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Study  7:  OR  to  Post-Operative  Care 

Our  initial  study  in  post-operative  care  was  chosen  to  contrast  a  high  risk  and  a  lower  risk  Type  2  handoff,  using  the 
same  measurement  methods,  in  order  to  understand  the  relative  efficacy  of  each.  By  examining  process  and 
teamwork  it  would  help  us  to  understand  not  only  the  relationship  between  the  two  in  these  types  of  handoffs,  but 
the  effects  of  the  different  levels  of  risk. 
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Using  direct  observation  methods  of  process,  task  and  teamwork,  we  observed  32  handoffs  from  the  OR  to  PACU, 
and  26  handoffs  from  OR  to  CSICU  using  the  same  data  collection  template.  This  direct  observation  method  collects 
data  on  patient  information  (6  items  -  name,  age,  history,  allergies,  diagnosis,  procedure,  current  state),  anesthetic 
information  (intraoperative  course,  bloods,  meds,  vitals,  fluids,  pain  relief,  lines,  post-op  investigations),  surgical 
information  (intraoperative  course,  blood  loss,  number  of  drains,  DVT  prophylaxis,  antibiotics,  feeding  plan),  and 
on  the  physical  tasks  (set  up  of  monitors,  pumps,  lines,  fluid  bags,  drains).  Teamwork  was  measured  on  a  scale  of  1- 
5  for  6  dimensions  (Leadership,  Cooperation,  Communication,  Assessment,  Situation  Awareness).  These  data  are 
shown  in  figure  18. 


Analysis  of  these  data  demonstrates  interactions  between  the  teamwork  measures  and  the  information  transfer. 
Using  a  linear  multiple  regression  using  total  information  transfer  process  completion  as  the  outcome  measure,  we 
found  that  there  is  a  correlation  with  Leadership  (p=  0.0084),  Cooperation  (p=  0.0002),  Communication  (p= 
0.0089),  task  completion  (p=  0.0017),  and  PACU  vs  ICU  (p=  0.0072).  Essentially,  information  transfer  is 
significantly  better  in  the  CSCIU,  but  independent  of  location,  is  also  better  if  the  equipment  is  set  up  beforehand 
and  if  teamwork  is  effective.  Perhaps  most  powerfully,  this  model  predicts  61%  of  the  variation  in  information 
transfer. 


■  PACU 

■  CSICU 


Figure  18:  PACU  and  SCICU  handoff  data 
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Study  8:  OR  to  Adult  Cardiac  ICU 

Recognizing  that  the  Cardiac  ICU  patients  provided  an  model  for  high-risk,  complex  patients  where  handoffs  are 
important  for  ongoing  care,  we  focused  on  this  group  for  a  second  set  of  observations.  Adapting  these  methods 
specifically  for  cardiac  surgery,  we  collected  data  from  40  handoffs  from  the  OR  to  CSICU.  The  direct  observation 
method  collected  data  on  patient  information  (7  items  -  name,  age,  history,  allergies,  diagnosis,  procedure,  current 
state),  anesthetic  information  (intraoperative  course,  bloods,  meds,  vitals,  fluids,  pain  relief,  lines,  post-op 
investigations),  surgical  information  (intraoperative  course,  blood  loss,  number  of  drains,  DVT  prophylaxis, 
antibiotics,  feeding  plan),  and  on  the  physical  tasks  (set  up  of  monitors,  pumps,  lines,  fluid  bags,  drains).  Teamwork 
was  measured  on  a  scale  of  1  -5  for  5  dimensions  (Leadership,  Cooperation,  Communication,  Assessment,  Situation 
Awareness). 

Mean  duration  was  7.13  minutes  ±  0.74,  mean  equipment  transfer  success  (from  13  items)  is  75%  ±  7%,  the  mean 
number  of  people  involved  is  7,  with  the  mean  information  transfer  (from  a  total  of  25  items)  is  57%  ±  5%,  and 
mean  teamwork  score  of  17.0  (out  of  30).  On  average,  less  than  60%  of  the  total  number  of  information  items  were 
handed  off.  Patient  name  is  mentioned  only  29%  of  the  time;  and  allergy  status  only  37%  of  the  time;  plan  for  pain 
relief  50%  of  the  time;  and  post-operative  investigations  12%  of  the  time.  Data  are  shown  in  figure  19.  Analyzing 
the  data  in  a  linear  regression  demonstrates  that  this  success  of  information  transfer  is  proportional  to  handoff 
duration  (p=0.048),  and  teamwork  score  (p=0.0017),  with  the  relationship  defined  as: 

%  Info  Transferred  =  25%  +  2%  per  minute  duration  +  1%  per  Teamwork  score 


To  explore  the  association  between  handoffs,  complications  and  outcomes  we  also  examined  length  of  stay  in 
relation  to  information  handoff  and  teamwork  score  (figure  20).  This  proved  inconclusive. 
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Figure  19:  Data  from  OR  to  ICU  Handoffs 
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Length  of  Stay 


Length  of  Stay 


Figure  20:  Length  of  stay  in  relation  to  information  and  teamwork  in  post-surgical  handoffs 


Intervention  Development 

Our  aim  was  to  construct  a  generic  template  for  improvement  that  could  be  adapted  for  different  scenarios.  The 
intervention  consisted  of  a  new  process,  consisting  of  new  preparation,  communication  and  teamwork  components. 
It  was  implemented  through  three  tools:  (i)  a  clearly  presented  and  laminated  process  (ii)  a  set  of  checklists  to  assist 
in  the  information  transfer  and  (iii)  laminated  role  cards  to  assist  in  teamwork  definition.  Considerable  efforts  were 
directed  to  develop  the  checklists  in  a  multi-disciplinary  team,  consisting  of  anesthesiologists,  surgeons,  ICU 
specialists,  cardiologists  and  nurses. 

Protocols  were  documented  and  updated  into  an  easy-to-use  form  as  the  interventions  are  developed  and  tested.  The 
protocol  for  preparation  of  patient  arrival  in  ICU  is  shown  below.  We  then  worked  with  the  clinicians  to  establish 
appropriately  clear  and  usable  documentation  that  assisted  clarity  and  sustainability  (figure  21). 

a)  Cardiac  Anesthesiologist/Fellow/resident:  will  complete  the  handoff  sheet  in  the  OR  prior  to  transfer  to 
CSICU 

b)  A  phone  call  (or  text)  to  the  CSICU  charge  nurse  (Voalte  phone  33471)  will  be  made  by  the  Cardiac 
Anesthesiologist  with  the  following  information: 

i.  Estimated  time  of  arrival 

ii.  Patient  Acuity:  High  or  Low 

iii.  Whether  the  patient  has  one  or  more  of  the  following  devices: 

PA  line,  LA  line,  CRRT,  IABP,  ECMO,  any  other  MCS  device 

iv.  Whether  the  patient  is  on  a  ventilator  or  extubated. 

c)  Prior  to  leaving  the  OR,  the  Attending  Cardiac  surgeon  will  review  the  handoff  sheet  in  order  to  make 
sure  that  there  is  agreement  on  all  the  parameters  listed 

d)  Upon  arrival  in  the  CSICU  the  handoff  report  will  be  given  based  on  the  items  listed  on  the  handoff 
sheet 

e)  Once  handoff  if  complete  and  the  scripted  content  has  been  covered  thoroughly,  any  questions 
answered  etc.,  the  handoff  sheet  will  remain  at  the  bedside  as  a  reference  point. 
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The  most  problematic  component  of  the  intervention  was  in  developing  a  better  method  for  communicating  between 
OR  and  ICU  prior  to  transfer.  A  smartphone  solution  platform  was  being  used  at  CSMC,  which  offered  a  solution 
for  the  need  to  warn  and  prepare  the  Charge  Nurse  for  the  arrival  of  the  patient.  However,  this  solution  (known  as 
the  Voalte  phone  system)  was  found  to  be  unreliable,  with  calls  not  getting  through.  A  work-around  was  developed 
for  the  smartphone  to  forward  the  call  to  the  ICU  phone  when  the  Charge  Nurse"s  Voalte  phone  was  not  answered. 

The  transfer  information  aids  are  shown  in  figures  22  and  23,  and  demonstrate  extensive  changes,  including  more 
comprehensive  ventilation  settings,  more  lines  and  drains,  more  drug  types  with  ,fall  man"  lettering,  more  details  on 
blood  products,  pace  makers,  and  the  addition  of  an  anesthesia  end  time  box  to  assist  in  glucose  management. 
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Figure  21:  Protocol  for  pre-admission 
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CICU  /  PICU  Off-Pump  Call  Report 
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Figure  22:  Information  Aid  for  Transfer  of  Adult  Cardiac  Patients  from  OR  to  CSICU  -  Early  Draft 
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Figure  23:  Information  Aid  for  Transfer  of  Cardiac  Patients  from  OR  to  ICU  -  Final  Draft 
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Results  of  the  Intervention 

The  handoff  protocol  achieved  90-95%  compliance,  and  was  generally  well  received,  though  some  surgeons  did  not 
actively  participate  or  become  engaged  in  the  process.  Comparing  results  before  and  after  the  intervention, 
anesthetic  information,  surgical  information  and  total  information  are  significantly  improved;  as  are  all  aspects  of 
teamwork  aside  from  situational  awareness.  Duration  was  slightly,  but  non-significantly  longer  in  the  post 
intervention  group  (9.00  minsi  1.2)  than  in  the  pre  intervention  group  (7.13  minsi  0.7). 


Study  9:  OR  to  Congenital  Cardiac  ICU 

Congenital  cardiac  surgery  is  high  risk  team  endeavor  where  teamwork  and  process  have  been  found  to  impact 
patient  outcomes  and  failure -to-rescue  directly18.  Our  previous  work  in  handoffs  in  this  area  had  implemented 
checklists,  process  re-design,  and  specific  teamwork  processes  (a  structured  briefing,  discussion  and  agreed  plan). 
This  lead  to  a  fundamental  improvement  in  our  handoff  process  that  has  since  provided  a  framework  for  a  number  of 
other  studies19"23.  We  sought  to  build  on  this  success  in  a  new  congenital  heart  service  to  examine  the  use  of 
simulation  and  workspace  layout,  as  well  as  previously  successful  interventions. 

Working  with  the  congenital  heart  surgery  team,  we  initially  conducted  observations  and  interviews,  mapping  out 
the  process  (figure  25),  and  engaging  staff  in  the  need  to  improve  handoffs.  Weekly  handoff  improvement  staff 
meetings  began,  to  define  and  review  the  process,  then  to  adapt  it  based  on  experience  of  the  previous  week.  This 
lead  to  the  development  of  the  transfer  form  (figure  26),  which  was  similar  to  the  adult  cardiac  format,  with  specifics 
designed  for  congenital  surgery.  Off-line  simulation  and  in-situ  simulations  (in  an  ICU  bay)  were  conducted  to 
understand  the  technology,  teamwork  and  information  transfer  requirements  and  pitfalls.  This  identified  several 
micro-process  changes  to  the  task,  the  requirement  for  different  equipment  to  allow  smoother  technology  transfer, 
and  also  identified  workspace  layout  challenges. 

The  photo  in  Figure  27  illustrates  how  vital  signs  monitors  could  be  obscured  from  sight  in  ICU  rooms  by  the 
configuration  of  the  stands.  With  two  stands-  which  are  not  uncommon,  particularly  amongst  the  sickest  patients  - 
this  problem  can  be  exacerbated  (right  photograph).  Not  only  is  the  monitor  not  visible  from  all  except  a  limited 
point  on  the  right  of  the  room,  but  the  nursing  workstation  is  cramped  and  the  ventilator  on  the  left  is  extremely 
close  to  the  bathroom  door.  This  is  a  classic  ergonomic  design  problem  which  had  the  potential  to  contribute  to  a 
range  of  unrecognized  complications.  Improved  vision  for  monitoring  was  resolved  inexpensively  and  effectively  by 
working  through  a  range  of  potential  solutions  through  in-situ  simulations,  and  working  with  the  estates 
management  team  to  change  the  monitor  arm  to  allow  greater  clearance  for  the  monitor  from  the  infusion  bags. 
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Figure  25:  Congenital  Heart  Surgery  Handoff  Processes 


PICU/NICU  ICU  Handoff  Assist  Checklist 


NOTES  &  OTHER  INFORMATION 

($y5TSX!J!&  difficulty  ventiaton,  unusual  reactions  to  anesthesia,  Weed  mg.  g$J) 


Name: 

Relationship: 
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Figure  26:  Information  Aid  for  Transfer  of  Congenital  Heart  Patients  from  OR  to  PICU 
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Group  1  Group  2 

Figure  28:  Results  from  the  intervention 


This  was  evaluated  in  two  distinct  phases  of  care.  GROUP  1  were  cared  for  prior  to  establishing  the  handoff  process, 
and  GROUP  2  were  cared  for  in  the  CHPICU  after  the  new  handoff  process  was  introduced.  29  patients  were 
included  in  the  study,  15  in  GROUP  1,  and  14  in  GROUP  2.  We  recorded  whether  a  organized  team  huddle 
occurred,  and  through  direct  observation,  flow  disruptions  in  5  categories  (organization,  team,  patient,  equipment, 
communication),  were  scored,  giving  a  process  score  from  zero  to  5.  We  also  scored  clinical  disruptions  in  5 
categories  (vitals,  bleeding,  general  clinical,  respiratory,  and  drugs),  giving  a  treatment  score  from  zero  to  5.  Finally, 
we  gathered  patient  treatment  concerns  after  6  hours  of  care  (defined  as  stable  or  unstable),  and  then  scored  the 
change  over  24  hrs  (defined  as  better,  the  same,  or  worse). 
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21  (72%)  patients  had  a  proceduralized  team  handoff,  while  8  did  not  follow  a  recognized  procedure  (4  in  both 
groups).  The  proceduralized  handoffs  helped  to  identify  communication  discrepancies  in  1  out  of  10  cases  (10%)  in 
GROUP  1  and  7  out  of  1 1  cases  (63%)  patients  in  GROUP  2.  Time  to  complete  the  handoff  was  significantly  less  in 
GROUP  2  (mean  =  22.5  mins±  8.0,  median  =  20  min),  compared  to  GROUP  1  (mean  =  38. 1±  11.9,  median  =  37.5 
min),  p=0.007.  There  was  a  also  a  halving  in  flow  disruptions  (Mean  Gpl=  1.5,  mean  Gp2  =  0.86,  p=0.19)  and 
treatment  problems  (Mean  Gpl=  0.8,  mean  Gp2  =  0.33,  p=0.04)  following  the  implementation  of  the  process.  In 
both  groups,  equipment  problems  were  frequent  causes  of  disruption,  with  organizational  problems  substantially 
reduced  in  group  2  (50%  of  Gpl  cases  to  Gp2  7%  of  cases).  Vitals  and  respiratory  problems  were  substantially 
reduced  in  Gp  2(36%  vs  7%;  21%  vs  0%).  However,  stability  in  the  6hr  and  24hr  periods  was  unchanged. 

Discussion:  Post-Surgery  Handoffs 

A  structured  handoff  process  improves  detection  of  missing  information,  reduces  handoff  duration,  flow  disruptions 
and  clinical  disruption.  Information  transfer  is  dependent  teamwork  and  process  (if  the  equipment  is  set  up 
beforehand).  This  observation  was  replicated  several  times  in  these  studies.  Workspace  issues  may  also  play  a  part, 
especially  in  the  location  of  the  handoffs  (PACU,  CSICU,  PICU)  and  the  environment  (room  and  equipment  layout). 

The  key  components  were  to  ensure  that  only  the  vital  handoff  items  are  on  the  sheet,  and  that  it  can  fit  on  two  sides 
of  normal  sized  paper.  We  conducted  several  development  and  engagement  cycles  with  both  the  adult  and 
congenital  cardiac  services.  This  allowed  us  to  conduct  the  development  in  parallel  to  benefit  from  cross-pollination 
of  ideas,  and  to  ensure  that  consistent  formats  are  developed,  while  the  high  risks,  regularity,  and  complexity  of 
cardiac  patients  provide  the  ability  to  model  the  handoff  process.  In  particular,  it  gave  us  the  ability  to  examine 
multiple  high-risk  care  transitions  with  more  frequency  than  would  have  been  available  in  trauma  care  alone.  It  also 
allowed  us  to  apply  team,  task,  and  technology  models  to  these  care  transitions  to  study  them  with  greater  statistical 
power  than  would  have  been  available  to  us  with  trauma  patients.  The  extension  to  pediatric  cardiac  surgery  has 
served  both  as  a  comparator  to  consider  the  components  of  translation  between  surgeries,  at  an  equivalent  or  higher 
level  of  risk  and  complexity.  This  has  allowed  us  to  more  rapidly  understand  and  develop  our  interventions  than 
would  have  been  possible  in  trauma  care  alone,  while  still  allowing  us  to  translate  our  findings  back  into  trauma  care 
toward  the  end  of  the  project. 

This  is  an  important  result  alone,  but  also  suggests  that  ensuring  equipment  setup  and  better  teamwork  might  lead  to 
improved  information  transfer  in  these  type  2  handoffs. 

Developing  a  team  handoff  process  is  important  in  reducing  the  variability  of  care  and  responding  to  deterioration 
and  other  patient  treatment  demands.  This  can  be  achieved  through  adapting  tasks  and  processes,  forms  and 
checklists,  teamwork,  workspace  and  both  treatment-related  technologies  (such  as  infusion  pumps)  and  information 
management  technologies. 
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Deterioration 

Introduction 

Unexpected  patient  deterioration  is  serious  and  frequent  problem  for  healthcare  teams.  While  ICU  outreach,  or  rapid 
response  teams  have  helped  to  ensure  better  responses,  there  has  been  little  progress  in  developing  better  methods  to 
avoid  or  identify  sick  patients.  From  a  different  perspective,  to  reduce  unnecessary  complications  associated  with 
deterioration,  it  is  beneficial  to  improve  the  identification  of  deterioration  as  well  as  the  response  once  deterioration 
is  identified.  To  develop  a  better  means  to  identify  deterioration  requires  either  an  improvement  in  the  diagnostic 
information  available,  or  an  improvement  in  expectation.  If  a  patient  is  expected  to  be  at  risk  of  deterioration,  they 
are  much  more  likely  to  be  identified  earlier  in  their  deterioration  than  a  patient  who  is  assumed  otherwise  to  be 
well. 

In  our  Phase  one  studies,  we  noted  that  improving  expectation  of  the  nature  of  an  arriving  trauma  case  -  through  the 
pre-arrival  display  of  vital  signs  and  mechanism  of  injury  -  combined  with  a  briefing  that  also  improved  teamwork, 
process  and  treatment  expectations,  contributed  to  a  reduced  time  in  the  ED  and  shorter  length  of  stay.  We  also 
noted  the  inadequacy  of  the  handoff  from  EMS  to  ED.  Thus,  to  examine  deterioration  along  the  trauma  pathway,  we 
first  studied  the  nature  and  type  of  injury  for  patients  arriving  via  EMS  and  arriving  in  the  ICU,  in  relation  to  their 
eventual  outcome.  Next,  we  examined  the  difference  between  EMS  and  ED  vital  signs  as  a  predictor  of 
deterioration.  Finally,  we  used  the  concept  of  failure  to  rescue"  (ie.  the  failure  to  appropriately  treat  deterioration)  to 
examine  the  predisposing  factors  to  deterioration  along  the  trauma  pathway. 

Study  10:  Predictors  of  Mortality  in  Trauma  Care 

The  National  Trauma  Database  (NTDB)  contains  a  range  of  fields  that  can  be  used  to  explore  the  effects  of  various 
system  and  patient  parameters  on  patient  outcomes.  We  identified  2,541  patients  within  this  database  who  had 
received  trauma  care  between  2009-2011.  Cases  were  stratified  according  to  ICD-9  code,  with  available  data  on 
admission  heart  rate,  oxygen  saturation,  systolic  blood  pressure,  initial  hematocrit,  ICU  length  of  stay,  and  Outcome. 
We  used  this  data  to  examine  the  relationship  between  injury  and  outcome,  and  to  examine  initial  vital  signs  in 
relation  to  outcome. 

The  relationship  between  ICD-9  injury  and  mortality  is  found  in  figure  29,  which  demonstrates  that  head  and  pelvic 
injuries  offer  the  greatest  threats  to  mortality,  with  chest  and  abdomen  injuries  less  fatal,  and  face  injuries  the  least 
fatal.  Examining  the  predictivity  of  vital  signs,  we  found  that  fatal  chest  injuries  have  lower  initial  heart  rate,  systolic 
blood  pressure,  and  oxygen  saturation.  Fatality  with  abdominal  injuries  and  bony  chest  injuries  are  also 
characterized  by  initially  lower  systolic  blood  pressure  (figure  30). 

Next,  we  selected  patients  who  had  been  treated  by  the  Cedars  Sinai  trauma  service  from  August  2011  to  November 
2012,  which  was  a  total  of  1577  patients,  of  whom  1507  lived  (95%).  We  then  conducted  a  more  detailed  analysis  of 
specific  items  related  to  the  change  in  vital  signs  from  the  EMS  in  the  field  to  the  ED.  By  examining  the  change 
between  initial  field  and  initial  ED  measures  of  systolic  blood  pressure,  pulse  rate,  respiration  rate,  oxygen 
saturation  and  GCS,  were  able  to  examine  the  deterioration  during  this  initial  period  (figure  31).  The  predictive  p- 
values  are  found  in  table  2.  These  encouraging  results  allowed  us  to  build  a  multi -variable  model  that  incorporates 
all  these  parameters  into  a  single  predictive  model.  Significant  factors  are  age  (Chi2=18.07,  Odds  Ratio=1.04, 
pO.OOOl),  change  in  Glasgow  Coma  Scale  (Chi2=3.09,  Odds  Ratio=1.19,  p=0.0482),  change  in  systolic  blood 
pressure  (Chi2=9.97,  Odds  Ratio=1.029,  p=0.0016),  and  change  in  Oxygen  saturation  (Chi2=5.50,  Odds  Ratio=1.05, 
p=0.0190).  The  ROC  curve  is  shown  in  figure  32. 
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Injury  Type  by  ICD-9 

Avg  HCTfor  Died 

Avg  HCTfor  Lived 

Abdomen 

35.8 

40.2 

Chest 

33.4 

40.6 

Chest  -  bony  injury 

38.4 

41.3 

Face 

46.7 

40.9 

Head 

36.8 

40.0 

Pelvic 

NA 

39.6 

Injury  Type  by  ICD-9 

Initial  HR  for  Died 

Initial  HR  for  Lived 

Abdomen 

124.17 

92.54 

Chest 
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98.50 

Chest  -  bony  injury 

93.67 

90.50 

Face 

74.50 

89.49 

Head 

89.94 

95.84 

Pelvic 

NA 
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Injury  Type  by  ICD-9 
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Injury  Type  by  ICD-9 
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Figure  30:  Injury  type  and  vital  signs  in  relation  to  mortality. 
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In  Field 

In  ED 

Difference 
( Absolute ) 

Difference 
( Modulus ) 

Systolic  Blood  Pressure 

0.09 

0.73 

0.11 

0.0003 

Heart  Rate 

0.49 

0.07 

0.27 

0.013 

Respiratory  Rate 

0.05 

<0.0001 

0.90 

0.0003 

02  Saturation 

0.020 

0.079 

0.11 

0.05 

GCS 

<0.0001 

<0.0001 

0.004 

0.09 

Table  2:  Predictors  of  mortality 


Figure  3 1 :  Means  and  95%CI  for  parameters  associated  with  subsequent  death 
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Figure  32:  ROC  curve  for  prediction  of  mortality  from  initial  vital  signs. 

Study  11:  In  hospital  failure-to-rescue 

We  examined  failure  to  rescue  (FTR),  defined  as  mortality  following  the  development  of  an  in-hospital 
complication.  The  factors  associated  with  increased  risk  of  FTR  following  trauma  are  largely  unknown. 

The  National  Trauma  Databank  (NTDB)  datasets  2007-2011  were  queried.  Exclusions  were:  Age  <  16  yr,  deaths  in 
the  ED,  patients  with  any  body  region  abbreviated  injury  scale  (AIS)  of  6,  injury  severity  score  (ISS)  of  75,  hospital 
length  of  stay  (LOS)  <  24  hours,  mechanism  other  than  blunt  or  penetrating,  admission  to  centers  reporting  <  80% 
of  AIS  and/or  <20%  of  comorbidities  and/or  <  200  subjects  in  the  NTDB.  All  patients  with  any  reported 
complication  were  then  selected  and  those  who  survived  (non-FTR)  were  compared  to  those  who  did  not  (FTR).  A 
forward  logistic  regression  model  was  utilized  to  identify  predictor  of  FTR.  The  risk  of  FTR  was  also  examined 
within  age  groups  and  number  of  complications. 

Of  3,313,117  eligible  patients,  218,986  (6.6%)  met  inclusion  criteria  and  had  at  least  one  complication  developed 
during  the  in-hospital  stay.  Of  those,  201,358  (91.2%)  survived  (non-FTR)  and  17,628  (8.8%)  did  not  (FTR). 
Compared  to  non-FTR  patients,  FTR  patients  were  more  likely  to  be  in  the  age  groups  65  to  89  yr  and  >  90  yr 
(49.4%  vs.  29.0%,  p<0.01  and  4.2%  vs.  1.2%,  p<0.01  respectively),  more  likely  to  require  an  ICU  admission  (89.6% 
vs.  56.3,  p<0.01)  and  mechanical  ventilation  (MV)  (73.4%  vs.  32.1%,  p<0.01). 

A  forward  logistic  regression  identified  22  variables  as  predictors  of  FTR.  Of  those,  age  65  to  89  (y)  was  the 
strongest  predictor  (AOR  [95%  Cl]:  6.58  [6.11,  7.08],  p<0.01),  followed  by  the  need  for  MV  (AOR  [95%  Cl]:  2.99 
[2.81,  3.17],  p<0.01)  and  an  ICU  admission  (AOR  [95%  Cl]:  2.61  [2.40,  2.84],  p<0.01).  The  AUC  for  the  model 
was  0.852.  Using  age  group  16  to  45  (y)  as  the  reference  group,  the  adjusted  risk  for  FTR  increased  with  increasing 
age  in  a  stepwise  fashion:  AOR  (95%  Cl):  1.94  (1.80,  2.09)  for  age  group  46  to  65  yr,  6.78  (6.19,  7.42)  for  the  age 
group  66  to  89  yr  and  27.58  (21.81,  34.87)  for  the  age  group  >  90  yr  (all  p<0.01).  The  same  applied  for  the  number 
of  complications;  the  adjusted  risk  of  FTR  increased  in  a  stepwise  fashion  with  increasing  number  of  complications.. 
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Figure  33:  The  relationship  between  complications  and  odds  associated  with  Failure  to  Rescue 

Discussion 

We  found  a  range  of  contextual,  patient  and  process  parameters  that  predict  clinical  deterioration  and  failure -to- 
rescue  in  trauma  patients.  Though  only  having  scratched  the  surface  of  what  might  be  possible,  this  is  encouraging 
for  being  able  to  indentify  at-risk  patients. 

Studies  in  deterioration  and  failure-to-rescue  are  complex  and  remain  challenging  to  observe  simply  because  they 
form  a  small  sub-set  of  the  overall  clinical  population.  Without  an  ability  to  collect  detailed  performance  -  often 
only  obtainable  via  direct  observation  -  it  is  challenging  to  examine  the  individual,  team  and  system  contributions  to 
these  events.  However,  our  work  has  already  demonstrated  from  a  number  of  indirect  observations  that 
physiological  stability  can  be  assisted  in  high  risk  patients  through  the  consideration  of  process,  team,  technology, 
and  environmental  parameters. 

Clearly,  given  the  challenges  in  responding  to  the  detailed  and  interacting  parameters  that  predict  deterioration  and 
FTR,  developing  technology  to  support  this  process  was  of  vital  importance  and  huge  potential  value.  This  was 
explored  in  the  final  set  of  studies. 
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Technology  Support 

Introduction 

Mobile  communications  displaying  the  critical  information  would  allow  even  earlier  building  of  situation  awareness 
and  team  cohesion  and  thus  provide  better  handoffs.  Originating  from  our  work  in  phase  1,  we  continued  the 
development  of  a  Smartphone  application  that  assists  in  the  early  management  of  trauma  patient  information.  We 
recognized  the  value  and  existing  uses  of  text  and  photos  to  communicate  about  patient  care,  and  became  interested 
in  the  ways  in  which  our  teamwork,  communication  and  patient  management  interventions  could  be  supported  and 
sustained  with  well  designed  smart  phone  technology.  Teamwork  can  be  enhanced  through  the  distribution  of 
information  to  a  smart  phone,  coupled  with  the  ability  to  provide  information  on  a  constantly  updating  electronic 
whiteboard.  The  provision  of  this  information  to  OR,  CT,  and  other  specialist  services  geographically  distributed  in 
the  hospital.  Together,  this  would  substantially  enhance  the  ability  for  clinicians  to  predict  and  respond  quickly  and 
appropriately  to  the  sickest  patients.  As  well  as  providing  a  better  response  for  individual  patients  and  better 
teamwork,  this  would  also  ensure  better  use  of  hospital  resources.  The  awareness  of  the  huge  range  of  physicians, 
nurses  and  other  specialists  involved  would  be  improved.  This  would  encourage  the  delivery  of  timely,  appropriate, 
error-free  care  to  the  patient.  A  modular  approach,  coupled  with  the  integration  of  wider  information  sources,  and 
designed  with  a  human-centered  understanding  of  decision  making  could  further  enhance  team  performance  not 
only  in  the  initially  assessment  phase,  but  right  through  CT  and  OR  care  to  ICU  admission  and  beyond. 
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Figure  34:  Trauma  360  app  screens 


This  simple  mobile  platform  allows  a  further  range  of  enhancements  that  might  considerably  aid  in  subsequent 
patient  care,  and  go  well  beyond  the  initial  purposes  of  enhancing  communication,  and  information  distribution. 
Like  the  flight  management  system  in  a  modern  aircraft,  this  presented  an  opportunity  to  investigate  a  system  of 
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systems"  that  provides  patient-centered  communication,  sensor  integration,  real-time  remote  access  to  dynamic 
patient  information,  diagnostic  support,  process  management,  care  planning,  and  hand-off  tools.  Theoretically,  this 
could  improve  communication  amongst  team  members  and  across  the  hospital  system  (such  as  CT,  OR  or  ICU).  It 
would  improve  integration  of  care  processes  and  diagnostics,  encourage  adherence  to  best  practice,  and  quality  & 
safety  processes.  It  would  support  handoffs  and  team  member  changes,  while  supporting  diversity  of  patients, 
patient-centered  care,  and  the  complexity  of  healthcare  delivery,  reducing  deterioration  and  improving  response. 

Study  12:  Development  of  a  coordination  and  communication  trauma  app 

As  part  of  our  ongoing  work  to  develop  smartphone  systems  to  assist  in  the  delivery  of  care  and  reduce  error  and 
flow  disruptions,  we  instigated  two  simulation  sessions  for  demonstration  and  evaluation  of  the  trauma360 
app. Scenarios  were  selected  and  designed  by  a  faculty  consisting  of  surgeons,  trauma  specialists,  simulation 
specialists,  and  human  factors  specialists.  The  trauma  teams  consisted  of  four  practicing  residents,  and  four 
experienced  ED  nurses,  with  a  trauma  attending  acting  as  part  of  the  research  and  simulation  team,  to  prompt  the 
residents  were  necessary.  For  one  simulation  session,  an  ED  fire  was  simulated  with  an  indoor  smoke  machine 
which  was  hidden  from  view  and  triggered  after  approximately  10  minutes. 

The  simulation  sessions  started  with  a  briefing  about  goals  and  aims,  which  included  downloading  of  the  Trauma 
360  app  and  basic  instruction  in  its  use.  There  was  then  a  familiarization  with  the  simulation  equipment  and  dummy, 
following  which  the  trauma  team  were  sent  to  disparate  locations  of  the  simulation  center  to  await  the  trauma  call. 
This  represented  disparate  hospital  locations  from  which  the  trauma  team  arrive.  Upon  paging,  and  (in  the  app  use 
condition,  app  paging),  the  team  arrived  in  the  simulated  ED  and  conducted  a  briefing.  After  5  minutes,  the 
simulated  patient  (a  Gaumard  Simulation  Dummy)  arrived  and  the  simulation  began  properly.  Completion  was  at 
the  moment  the  simulated  patient  was  moved  out  of  the  ED,  as  if  to  go  to  imaging  (or,  in  the  case  of  the  fire 
scenario,  as  if  to  be  evacuated).  A  debriefing  was  conducted  after  a  short  rest,  which  consisted  of  guided  discussion 
on  technical,  teamwork,  and  technology  related  learning  points  and  issues  that  had  arisen  in  the  simulation.  A  video 
recording  was  made  that  allowed  the  participants  to  review  their  own  performance.  As  part  of  the  debriefing,  the 
team  were  asked  to  complete  a  NASA  TLX  (Task-Load  Index)  to  assess  overall  perceived  workload  during  the 
simulation. 

The  simulations  were  extremely  successful,  and  served  as  a  formative  test  of  the  utility  and  usability  of  the  trauma 
360  app  for  encouraging  communication,  improved  handoffs  and  increased  adherence  to  trauma  protocols  and 
checklists.  Participants  reported  that  it  was  a  valuable  experience  for  all  involved,  and  benefitted  from  a  competent 
leader  and  previous  experience  in  simulation.  They  found  the  Trauma  360  app  to  be  helpful  for  displaying  when  a 
patient  is  expected,  and  the  vital  signs,  and  expressed  how  much  they  missed  not  having  this  information  (the  usual 
standard  of  care)  when  it  was  not  available.  The  large  screen  display  of  that  information  was  useful,  and  the  team 
suggested  additional  functionality,  including  an  integrated  checklist  with  specific  care  protocols  to  aid  in  decision 
making  and  optimal  care.  The  results  of  the  workload  rating  are  found  in  figure  36,  which  suggest  that  though 
workload  was  slightly  higher  with  the  app,  these  differences  were  non-significant,  whereas  there  was  a  significant 
reduction  in  distractions. 


W81XWH-1 1-1-0813 


Page  39  of  77 


Figure  35:  Photographs  of  simulation  session  2. 

Clockwise  from  top  left:  the  simulated  patient 
arrives  in  the  simulated  ED;  the  manikin  is 
prepared  by  a  simulation  technician;  the  trauma 
team  ventilat  the  patient;  the  simulation  team 
treat  the  patient;  a  fire  breaks  out  in  the  trauma 
bay;  the  team  assess  the  patient;  the  prepared 
simulation  space. 
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Figure  36:  NASA  Task  Load  Index  subjective  workload  ratings. 


Discussion 

New  technology  is  introduced  into  healthcare  everyday  with  little  consideration  of  the  impact  on  the  clinical  user. 
This  can  have  an  impact  on  patient  care.  We  aimed  to  understand  the  impact  of  this  new  technology,  before  being 
introduced  into  the  real  environment. 

The  trauma  360  app  was  useful,  easily  useable  and  well  liked  by  the  trauma  and  ED  nursing  team.  It  allowed  them  to 
prepare  better  for  the  incoming  patient,  which  provided  better  expectation  and  improved  handoffs.This  suggests  that 
further  development  of  the  Trauma  360  would  be  warranted.  To  fully  benefit,  future  simulations  should  include 
broader  array  of  simulated  services  and  roles  -  such  as  MICN,  EMS,  ER  Attending-Resident,  OR,  CT, 
Pharmacy/Blood  Bank,  At-Home  Specialist/Surgeon.  This  could  be  facilitated  by  designating  different  areas,  within 
the  flexible  simulation  space,  to  represent  the  different  points  of  the  care  continuum,  such  as  CT,  Surgery  and  ICU. 

In  the  future,  we  will  seek  to  develop  an  even  more  robust  “human-centered”  application  that  i)  integrates  and 
distributes  a  range  of  patient  information  to  clinicians,  ii)  allows  patient-centered  communication  management  iii) 
supports  clinical  decision  making  and  iv)  accounts  for  teamwork  requirements  and  information  system  constraints. 
This  should  include  enriched  decision  support  and  embed  it  into  the  app  such  that  informationis  provided  at  the  right 
time,  in  the  right  way,  precisely  whereit  is  needed  -  at  the  point  of  care.  Continued  funding  would  support  simulation 
and  live  trials  to  test  the  utility  of  this  app  in  a  wide  range  of  military  and  civilian  environments  and  other  acute 
illnesses  such  as  ruptured  aortic  aneurysms,  stroke  and  acute  myocardial  infarction. 
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4.  KEY  RESEARCH  ACCOMPLISHMENTS 

Study  1,  which  generated  process  maps  for  a  range  of  handoffs  found  may  different  types,  with  several  synchronous 
and  asynchronous  communication  methods.  We  summarized  handoffs  into  type  1  (location  change,  team  constant) 
and  type  two  (location  and  team  both  changed).  In  study  2  we  interviewed  providers,  who  emphasized  transfer  of 
responsibility  and  information  transmission,  with  teamwork  being  essential  for  good  handoffs.  Study  3  analyzed 
incident  data,  and  found  that  task  and  team  factors  predisposed  to  these  events,  in  part  due  to  the  complex  sequence 
of  communication  tasks  required  for  effective  handoff.  In  study  4,  we  observed  several  hundred  flow  disruptions 
during  trauma  handoffs,  over  half  of  which  were  attributed  to  communication,  and  which  affected  the  higher  risk, 
more  urgent  patients  the  most.  This  combination  of  studies  demonstrated  the  task  and  team  complexity,  variability 
and  criticality  of  high  risk  handoffs. 

Looking  at  pre-surgery  handoffs,  study  5  suggested  that  while  there  was  a  general  consensus  that  handoffs  in  the 
surgical  ICU  were  acceptable,  there  were  nonetheless  gaps  and  weaknesses  in  the  process.  Communication  was 
complicated  by  the  number  of  phone  calls  which  were  needed  to  complete  the  full  process,  but  were  not  always 
completed.  Moreover,  between  10%  and  30%  of  patients  were  sicker  than  expected  following  the  handoff.  A  simple 
checklist  intervention  for  transferring  patients  to  imaging  seemed  to  have  benefits  in  study  6,  and  after  initially  being 
unsustained,  was  redesigned,  re-implemented,  and  sustained  following  a  salient  incident  that  would  have  been 
originally  presented.  This  work  illustrated  that  though  relatively  low  risk  handoffs,  critical  safety  and  performance 
improvements  were  possible.  Sustainability  depends  on  the  perception  of  need  amongst  the  staff,  which  for  these 
handoffs  was  generally  low. 

Study  7  explored  handoffs  from  the  OR  to  the  PACU  and  Cardiac  ICUs  through  direct  observation,  measuring  the 
information  handed  off,  the  time  of  each  handoff,  and  teamwork  on  a  5  point,  5  dimension  scale.  We  found  that 
information  transfer  is  significantly  better  in  the  CSCIU,  but  also  better  if  the  equipment  is  set  up  beforehand  and  if 
co-operation,  communication  and  leadership  are  effective.  In  study  8  we  examined  the  Cardiac  ICU  data  further, 
finding  a  relationship  between  information  transfer,  teamwork  and  handoff  duration,  but  not  with  outcomes.  We 
then  developed  an  intervention  of  role  definition,  process  development,  and  information  transfer.  This  achieved 
approximately  90%  compliance,  information  transfer  was  improved,  as  were  all  teamwork  scores.  This  was  further 
examined  in  congenital  heart  surgery  in  Study  9.  As  part  of  a  similar  checklist  and  task-based  intervention,  we  also 
improved  the  ICU  workspace  to  provide  better  views  of  the  monitors,  improving  situational  awareness. 

In  order  to  explore  patient  deterioration,  study  10  explored  predictors  of  mortality  in  trauma  care,  finding  that  as 
well  as  being  able  to  predict  outcomes  from  injury  type,  we  were  also  able  to  build  a  multi-variable  model  that 
related  changes  in  physiological  measurements  between  pre-hospital  EMS  and  ED  with  mortality  rate.  Study  1 1  then 
explored  failure -to-rescue  in  hospital,  demonstrating  complications  and  ages  as  a  predictor.  Finally,  study  12 
examined,  in  simulation,  the  use  of  a  smart  phone  app  to  assist  in  communication  across  the  trauma  pathway  from 
pre-hospital  to  ED  trauma  care.  This  demonstrated  positive  effects  on  performance  and  has  subsequently  been 
developed  into  a  fully  deployable  software  solution. 

5.  CONCLUSION 

Handoffs  can  be  improved,  and  deterioration  reduced  by: 

•  Considering  the  purpose,  requirements  and  process  of  handoff 

•  Facilitating  the  transitions  of  the  highest  risk  patients 

•  Use  of  checklists,  task  designs,  and  teamwork  training 

•  Optimizing  the  relationship  between  information  transfer,  team  skills,  and  time  available  for  the  handoff. 

•  Improving  the  working  environment  to  ensure  availability  of  monitoring  information  and  patient  data. 

•  Considering  particular  patient  risk  factors  for  deterioration  and  planning  for  such  events. 

•  Supporting  situational  awareness,  decision  making,  teamwork  and  communication  through  the  use  of 
carefully  designed  and  integrated  software  on  mobile  and  fixed  platforms. 
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6.  PUBLICATIONS,  ABSTRACTS  AND  PRESENTATIONS 

This  details  all  the  academic  products  that  this  research  supported,  either  through  direct  publication  of  findings,  or 
through  opportunity  collaborations  with  other  human  factors  and  handoffs  researchers. 

Lay  Press 

J.  Frenec:  Joint  OR  project  explores  design  and  communication.  Health  Facilities  Management.  4/24/14. 
http://bit.ly/SwUcyV 

D  Helfand.  Cedars-Sinai  partners  with  the  U.S.  military  to  design  ’’operating  room  of  the  future”.  News  Medical 
4/16/14.  http://bit.ly/13F8UcK 

Akanksha  Jayanthi.  Cedars-Sinai  Partners  With  Military  to  Design  ’Operating  Room  of  the  Future’.  Becker"s 
Hospital  Review.  4/26/14.  http://bit.ly/lxsXfKr 

Liz  Stinson.  How  Designers  Are  Reinventing  Trauma  Care  to  Save  Soldiers"  Lives.  Wired.  07/25/14. 
http  ://wrd.  cm/ 1  omk!r3 


Peer-Reviewed  Scientific  Journals 

X  Shao,  X  Zhong,  J  Li,  B  Gewertz,  K  Catchpole,  E  Ley,  J  Blaha,  D  Wiegmann  (2014).  Bottleneck  Analysis  to 
Reduce  Surgical  Flow  Disruptions:  Theory  and  Application.  IEEE  Transactions  on  Automation  Science  and 
Engineering,  99:  1-13.  10.1 109/TASE.2014.2329833. 

K  Catchpole,  E  Ley,  D  Wiegmann,  J  Blaha,  D  Shouhed,  A  Gangi,  R  Blocker,  R  Karl,  C  Karl,  B  Taggart,  B  Starnes, 
B  Gewertz.  (2014).  A  Human  Factors  sub-systems  approach  to  trauma  care  reduces  disruptions,  treatment  time,  and 
length  of  stay.  JAMA  Surgery.  Published  online  August  06,  2014.  doi:10.1001/jamasurg.2014.1208 

E  Robertson,  L  Morgan,  S  Bird,  K  Catchpole,  P  McCulloch  (2014).  Interventions  employed  to  improve  intra¬ 
hospital  handover:  a  systematic  review.  BMJ  Quality  and  Safety.  0:1-8.  doi:10.1 136/bmjqs-20 13-002309. 

Catchpole  K  (20 13). Toward  the  modelling  of  safety  violations  in  healthcare  systems  .BMJ  Quality  and 
Safety,  doi:  10.113  6/bmj  qs-20 1 2-00 1 604. 

Catchpole  K,  Gangi  A,  Blocker  R,  Ley  E,  Blaha  J,  Gewertz  B,  Wiegmann  D  (2013).  Flow  disruptions  in  trauma  care 
handoffs.  Journal  of  Surgical  Res  earch.pii:  S0022-4804(13)001 15-7. 

S  Hignett,  P  Carayon,  P  Buckle,  K  Catchpole  (2013).  State  of  Science:  Ergonomics  and  Human  Factors  in  Health 
and  Community  Car q.  Ergonomics.  DOI  10.1080/00140139.2013.822932. 
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Catchpole,  K  (2015).  Human  Factors  and  Outcomes  in  Pediatric  Cardiac  Surgery.  In  P  Barach,  J  Jacobs,  S  Lipshultz, 
P  Laussen,  (eds.).  Pediatric  and  Congenital  Cardiac  Care  Volume  2  -  Quality  Improvement  and  Patient  Safety,  pp 
367-376.  London:  Springer- Verlag.  ISBN  978-1-4471-6565-1.  DOI  10.1007/978-1-4471-6566-8 

K.  Catchpole  (2014).  Foreward.  In  P.Waterson  (ed).  Patient  Safety  Culture:  Theory,  Methods  and  Practice. 
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and  Healthcare  Improvement  at  a  Glance.  Wiley  Blackwell,  ISBN  978-1-118-36136-8. 
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A  Gangi,  E  Ley,  DWiegmann,  J  Blaha,  D  Shouhed,  H  Enos,  B  Gewertz,  B  Starnes,  R  Rush,  K  Catchpole  (2014). 
Comparison  of  Civilian  and  Military  Trauma  Teamwork  and  Safety  Attitudes.  Journal  of  Surgical  Research,  186  (2). 
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A  Gangi,  K  Catchpole,  R  Blocker,  J  Blaha,  D  Shouhed,  B  Gewertz  (2013).  Human  factors  methods  improve 
efficiency  in  emergency  trauma  care.  Journal  of  the  American  College  of  Surgeons  217(3):  S100-S101 

Maghen  N;  Behringer  E;  Weber  A;  Arabia  F;  DeCastro  M;  Wiegmann  D;  Catchpole,  K..  (2014).  Improving  the 
transfer  of  critical  patient  information  from  OR  to  Cardiac  Surgical  ICU  (CSICU):  Observational  Analysis  of 
present  practice.  Western  Anesthesia  Residents  Conference.  Critical  Care  Medicine  42  (12),  A1557.  Won  Third 
place  out  of  >100  for  best  research. 

Phillips  et  al.  “Using  human  factors  analysis  to  improve  perioperative  handoffs  following  congenital  heart  surgery” 
Submitted  to  Western  Surgical  Association. 

Presentations 

K.  Catchpole,  R.  Blocker,  E.  Ley,  A.  Gangi,  J.  Blaha,  B.  Gewertz,  D.  Wiegmann.  Flow  Disruptions  in  Trauma  Care 
Handoffs.  8th  Annual  Academic  Surgical  Congress,  February  5-7,  2013  in  New  Orleans,  LA. 

K.  Catchpole,  R.  Blocker,  Improving  Hand-Offs  Through  Motor  Racing  Analogies  and  Human  Factors  Research, 
Association  for  Perioperative  Registered  Nurses  (AORN)  Annual  Conference  in  San  Diego,  USA  Mar  3-7,  2013. 

K.  Catchpole.  Task,  Team  and  Technology  Integration  in  Surgical  Care.  Invited  oral  presentation  at  the  2013 
Symposium  on  Human  Factors  and  Ergonomics  in  Health  Care,  March  1 1-13,  2013,  Baltimore,  Maryland,  USA 

*K.  Catchpole.  Task,  Team  and  Technology  Integration  in  Surgical  Care.  Invited  oral  presentation  at  the  2013 
Institute  for  Ergonomics  and  Human  Factors  Annual  Conference,  Cambridge,  UK,  15- 18 Apr,  2013. 

*A.  Gangi,  K.  Catchpole,  R.  Blocker,  D.  Wiegmann,  B.  Gewertz,  J.  Blaha,  E.J.  Ley.  Time  To  Prepare  Impacts 
Emergency  Department  Efficiency  And  Flow  Disruptions. Quick  Shot  Presentation  at  the  8th  Annual  Academic 
Surgical  Congress,  February  5-7,  2013  in  New  Orleans,  LA. 

*K.  Catchpole,  E.  Salas,  D.  Wiegmann,  S.  Parker,  B.  Wears,  R.  Blocker.  Teamwork  and  Handoffs  in  Trauma  Care: 
Measurement,  Modeling  and  Improvement.  Panel  Discussion  at  the  Human  Factors  and  Ergonomics  Society  Annual 
Conference,  October  1-4,  20 13  San  Diego,  CA. 

*K  Catchpole,  E  Ley,  D  Wiegmann,  J  Blaha,  D  Shouhed,  A  Gangi,  R  Blocker,  B  Gewertz  (2014).  A  Human  Factors 
Sub-Systems  Approach  to  Trauma  Care  Reduces  Disruptions,  Treatment  Time  and  Length  of  Stay.  Pacific  Coast 
Surgical  Association  Annual  Meeting,  Dana  Point,  CA  February  14-17,  2014 

Catchpole,  K  (2014).  Task,  Team  and  Technology  in  the  OR.  Society  of  Cardiovascular  Anesthesiologists,  New 
Orleans,  29th  March  -  2nd  April  2014. 

Catchpole,  K  (2014).  MRI  and  Patient  Safety  -  Case  Studies.  Radiology  Conference  UK,  Birmingham,  9-1 1th  June 
2014. 

Catchpole,  K  (2014).Human  Errors  in  Healthcare,  Keynote  Address,  Radiology  Conference  UK,  Birmingham,  9- 
11th  June  2014. 


7.  INVENTIONS,  PATENTS  AND  LICENSES 

Nothing  to  report. 


8.  REPORTABLE  OUTCOMES 

•  The  most  comprehensive  assessment  of  multiple  handoffs  across  a  health  system  ever  conducted. 

•  Comprehensive  process  mapping  of  transitions  of  care 
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•  Detailed  analysis  of  flow  disruptions  in  trauma  care  handoffs 

•  Clear  demonstration  of  the  relationship  between  task,  team  and  process  in  handoffs 

•  Development  of  a  simple  emergency  department  to  imaging  transfer  checklist 

•  Development  of  checklist  interventions  to  improve  transfer  from  operating  room  to  ICU 

•  Identification  of  process  and  patient  features  associated  with  deterioration  and  failure -to -res cue 

•  Development  of  a  smartphone  app  to  improve  communication  from  emergency  medical  services  to  trauma 
team,  and  within  the  trauma  team. 

9.  OTHER  ACHIEVEMENTS 

•  Development  of  a  smartphone  application  to  improve  communication  from  emergency  medical  services  to 
trauma  team,  and  within  the  trauma  team. 

•  Development  and  deployment  of  a  purpose-designed  research  simulation  facility 
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APPENDIX  1:  Studies  against  tasks 


Aim  3  Studies  Aim  4  Studies 

Task  A 

Process  mapping  of  current  state  of 
communication  and  data  transfer 

Study  1 

TaskB 

Data  collection  on  process  deviations 

Studies  2,  3  and  4 

Studies  2,  3  and  4 

Task  C 

Analysis  and  items  categorized 

Study  2,  10  and  1 1 

TaskD 

Prospective  data  collection 

Studies  4-9 

Task  E 

Root  cause  analysis 

Study  3 

TaskF 

Feedback  to  current  stakeholders 

Studies  4-9 

Studies  10-11 

Task  G 

Identify  areas  of  high  priority/high 
impact/high  risk 

Task  H 

Design  potential  interventions 

Studies  6,8,9,12 

Task  I 

Develop  protocols 

Task  J 

Tests  of  change  in  simulation 

Study  12 

Task  K 

Successful  interventions  tested  and  refined  at 
CSMC  and  partners 

Studies  6,8,9,12 

Task  L 

Findings  disseminated  as  best  practices 
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APPENDIX  2:  Data  Collection  Methods 

ED  to  Imaging  Data  Collection  Template 


Date 


Page;  Announced  Time 

Observer  ID 

Observatwn  Type  (100}  1200]  [Code  Brain] 

Patient  Arrival 

first  Discussion  of  CT 

CT  Estimated  Warf  Tme 

Time  Order  Entry 

Time  CT  Ready 

Time  To  CT 

Did  not  go  to  CT 

Time  Ami«  «i  CT 

Pleese  circle  Much  team  entered  CT  order. 

Orders  Placed 

1  CT  head  [non-contrast) 

E0  TR  N/A 

2.  CT  C -sprne  |nor>-ccntrast) 

E0  TR  N/A 

3.  CT  ahd/pelvis  (w  fV  contrast)  v»/ 

EO  TR  N/A 

reconstruct  kxi  of  T/L  spine 

4.  CT  aOd/pelvis  (non-contrast) 

EO  TR  N/A 

5  CT  face  (can  include 

E0  TR  N/A 

reconstruction) 

6.  CT  neck  angio 

EO  TR  N/A 

7.  CT  chest  angio 

EO  TR  N/A 

8.  CT  extremities  (upper/ lower) 

E0  TR  N/A 

♦or  fracture  vs  ANGIO  for  vascular 

9  CT  Thoracic/ Lumbar  spine 

E0  TR  N/A 

(w/out  abd) 

10-Other 

EO  TR  N/A 

«er  Members  Present  nor 

rranwen 

tf  delayed  please  enter  time 

Itvjie 

Nurse 

YES  NO  N/A 

log  Tech 

YES  NO  N/A 

Trauma /Ned  ro  Team  Members) 

rES  NO  N/A 

Pharmacist 

YES  NO  N/A 

Respiratory 

YE$  NO  N/A 

Patient/Te^m 

A  Patient  on  Monitor 

YES  NO  N/A 

preparedness 

8  Transport  Bag 

YES  NO  N/A 

C.  Additional  Pam  Metis, 

YES  NO  N/A 

0  CT  Orders  Entered 

YES  NO  N/A 

E  Remove  Metallic  Items 

YES  NO  N/A 

f.  Arm  Bards  placed 

YES  NO  N/A 

G.  Scanner  Assignment 

YES  NO  N/A 

?Leaseci:di  CT  tfrcir. 


Start  Time/EmS  Time- 


i  Offers  haceri  upen 

t  rtl  in  -rp- 

[1|  pt]r3]  !4][51iB]r7]  [t]  [9]  (lOi  YES  MO  W/A 

i^-rJ/TFiin  P^pai-HjfieJS 
in  Lir.vt  uT-CT 

YES  m  N/A 

A.  Place  panent  on  Monitor 

B-AdditiMPiinMeds  yes  mo  n/a 

C  CT  Order;  Entered  YE5  MO  N/A 

D.  Remove  Mealic^enis  YES  NO  N/A 

E.  Patient  in  right  direction  YES  MO  .N/A 

F  Strap  patient  in  YES  MO  N/A 

G.  lab  Results  YES  NO  N/A 

|sianiiffifc/£hdTltfve 


Tin  1 4-  CT  iiJrViini:  Sisn-s 


finer  PTTfpgnt^ne-35 


Rtm&vt  Metallic  item*? 

TWiPf: 

Crhgf. 


tes  no  n/a_ 

YE5  HO  *1/^7 
'fE5  KO  N/A 


Jers  Paced  -s^tf  CT  Stance! 


[ij  [2]  m  i4j  n\  :&j  pi  [6]  m  Lit)!  m  no  n/a 


s  CT  EcarmngEfHSs-. 


EP1  TOfll  mi\ 


Tirilt  DtMitlTfQifl  CT 


AVI  WORK 
plicic  Irtaa-nos  dT 

LVsgJlian 

Ottcn/if  Asystsrvce. 
fio)e  Confusion. 
Rea*acJ(/Checttiafks. 
m  utti  o  nty  C 


Leadership 

5  4 

3 

2 

1 

CiewJy-AefW-dt^J.e^.er. Good 

Time  management,  ail  tasks 
completed,  non-hierarch  ical 

Individual  defined,  butsometasks 
not  completed. 

Identity  of  team  leasernot  clear 

Cooperation  and  Resource  Management 

5  4 

3 

2 

1 

All  team  membersclearlyfill  a  role 
and  perform  all  designated  tasks 

Identity  of  all  members  notclear, 
some  do  not  perform  assigned  tads 

Unable  to  discern  role  identity  of 

team  members 

Communication  and  Interaction 

5  4 

3 

2 

1 

Clear  communicationwith  team 

leader  asa  hub,  relayedto  scribe 

Assessment  and  decision  making 

5  4 

Communication  not  always 
through  team  leader, or  not 
relayed  rapidly  to  scribe 

3 

2 

Unorganized  or  incoherent 
communication  on  many  different 

levels 

1 

surveys.  Plan  communicated  to  team 

Assessment  somewhat  out  of 

order  all  majortaskscompiete 

1  and  2  survey  disorderly  and/or 
iOjyjOTtbgjg^not  dear. 

Situation  Awareness/coping  with  stress 

5  4 

3 

2 

1 

Untoward  findings  and  distractions 
did  no  upset  systematic  andorderly 
flow.  Team  iscalm  and  plans  ahead. 

Untoward  findingseause 
disruption  but  did  not  predude 
task  com  pletioa 

U  ntoward  fi  nd  i  r^s  or  i  nterruptions 
completely  upset  orderly  assessment 
and  task  completion  not  antiapatory. 
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OR  to  ICU  Handoff  Data  Collection  Template 


Information 


Patient  information: 

Yes 

No 

N/A 

Patient  name 

Age 

Medical  History 

Allergy  Status 

Diagnosis 

Name  of  procedure 

Patient  current  condition 

Anesthetic  information: 

Yes 

No 

N/A 

Intraoperative  anesthetic  course  and  any  complications 

Blood  transfusion  (had/needs),  location  of  blood  bags 

Relevant  medications  patient  received  in  theatre 

Plan  for  monitoring  (vitals  parameter  range  and  action) 

Plan  for  intravenous  fluids 

Plan  for  pain  relief 

Plan  for  lines,  eg.  Central  venous,  arterial 

Postoperative  investigations,  eg  Hb,  Cxray 

Surgical  information: 

Yes 

No 

N/A 

Intra  operative  surgical  course  and  any  complications 

Blood  loss 

Number  of  drains  and  plan 

DVT  prophylaxis  plan 

Antibiotic  plan 

Feeding  plan 

Tasks 


Equipment  tasks: 

Yes 

No 

N/A 

Monitors  and  alarms  set  up  before  handover 

Pump  ready  before  the  handover 

Lines  arranged  and  set  up 

Urine  bag  located  appropriately 

Drains  located  safely 

Patient-specific  tasks: 

Yes 

No 

N/A 

Patient  having  oxygen 

Patient  well  covered 

Patient  having  good  pain  relief 

Teamwork: 


Very  Bad _ Very  Good 


Leadership 

0 

1 

2 

3 

4 

5 

6 

Cooperation 

0 

1 

2 

3 

4 

5 

6 

Communication 

0 

1 

2 

3 

4 

5 

6 

Assessment 

0 

1 

2 

3 

4 

5 

6 

Situation 

0 

1 

2 

3 

4 

5 

6 
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Flow  disruptions  in  trauma  care  handoffs^ 
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^Department  of  Surgery,  Cedars -Sinai  Medical  Center,  Las  Angeles,  California 
b  Department  of  Indus  trial  and  Systems  Engineering,  University  of  Wisconsin,  Madison,  Wisconsin 


ARTICLE  INFO 


ABSTRACT 


Article  history: 

Received  3 January  2D  13 
Received  in  revised  form 
15  February  2D  13 
Accepted  19  February  2013 
Available  online  13  March  2013 


Keywords. 

Safely 

Error 

Handoff 

Transition 

Trauma 

Human  factors 

Disruptions 


Background:  Effective  ban  doffs  of  care  are  critical  For  maintaining  patient  safety  and 
avoiding  communication  problems.  Using  the  flow  disruption  observation  technique,  we 
examined  transitions  of  care  along  the  trauma  pathway.  We  hypothesized  that  more 
transitions  would  lead  to  more  disruptions,  and  that  different  pathways  would  have 
different  numbers  of  disruptions. 

Methods:  We  trained  observers  to  identify  flow  disruptions,  and  then  followed  181  patients 
from  arrival  in  the  emergency  department  (ED)  to  the  completion  of  care  using  a  specially 
formatted  PC  tablet  We  mapped  each  patient's  journey  and  recorded  and  classified  flow 
disruptions  during  transition  periods  into  seven  categories. 

Results:  Mapping  the  transitions  of  care  shows  that  approximately  four  of  five  pa  dents  were 
assessed  in  the  ED,  transferred  to  imaging  for  further  diagnostics,  and  then  returned  to  the 
ED.  There  was  a  mean  of  2.2  ±  0.09  transitions  per  patient,  a  mean  of  0.66  ±  0.15  flow 
disruptions  per  patient,  and  0.31  ±  0.07  flow  disruptions  per  transition.  Most  of  these  (53%) 
were  related  to  coordination  problems.  Although  disruptions  did  not  rise  with  more 
transitions,  patients  who  went  di  reedy  to  the  operating  room  or  needed  direct  admission  to 
intensive  care  unit  were  significantly  more  likely  [P  -  Q.QQ2B)  to  experience  flow  disruptions 
than  those  who  took  other,  less  expedited  pathways. 

Conclusions:  Transitions  in  trauma  care  are  vulnerable  to  systems  problems  and  human 
errors.  Coordination  problems  predominate  as  the  cause.  Bicker,  time-pressured,  and  more 
at-risk  patients  are  more  Likely  to  experience  problems.  Safety  practices  used  in  motor 
racing  and  other  industries  might  be  applied  to  address  these  problems. 

•3  2013  Elsevier  Inc.  All  rights  reserved. 


1.  Introduction 

Patient  care  iraEisiliOEis—  for  example,  changes  in  patients' 
locations,  care  teams,  or  both— are  often  critical  times  that  can 
tie  associated  with  medical  errors  [1,2].  As  a  consequence,  it 
has  been  recognized  that  effective  handoffs  of  care  are 


necessary  for  maintaining  safety  [3|.  There  has  been  consid¬ 
erable  interest  in  examining  shift- to -shift  handoffs  and 
handoffs  h  orn  die  emergency  depar  tment  (ED)  to  the  receiving 
team  [4-6],  but  no  studies  have  examined  the  subsequent 
transitions  experienced  by  this  vulnerable  but  heterogeneous 
group  of  patients  who  may  be  extr  emely  sick  and  are  at  risk  of 


*  Presented  at  the  annual  meeting  of  the  Academic  Surgical  Congress  in  New  Orleans,  Louisiana,  February  5-7,  2013. 

‘  Corresponding  author.  Department  of  Surgery,  Cedars -Sinai  Medical  Center,  8797  Beverly  Boulevard,  Suite  302,  Los  Angeles,  CA  90048. 
Tel:  41  310  423  4398;  fax:  +1  310  423  8503. 

E-mail  address:  ken.catchpoie@safersurgery.co.uk  (K.R  Catchpole). 

0Q2 2 -48 04 /S  -  see  front  matter  3  2013  Elsevier  tnc.  AD  rights  reserved, 
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rapid  and  unexpected  deterioration.  Id  contrast  ta  other 
studies  that  consider  care  transitions  in  terms  affixed  hand¬ 
overs  with  standard  in  form  ation  [7  ,E] .  ED  patients  m  ay  follow 
diverse  treatment  paths  and  are  frequently  moved  to  sever  al 
other  locations  within  the  hospital,  such  as  the  imaging  suite, 
the  intensive  care  unit,  or  the  operating  roam  (OR) .  Because 
such  transfers  are  often  carried  out  under  time  and  resource 
pressure  by  different  teams,  this  activity  requires  a  range  of 
support  and  monitoring  equipment,  documentation, 
comm  unication ,  and  coordination  activities  to  ensure  that  the 
process  is  executed  smoothly. 

The  concept  of  flow  disruptions  (FD)  [9]  defined  as  devi¬ 
ations  from  the  natural  progression  of  a  procedure  that 
potentially  compromise  safety  or  efficiency  has  previously 
been  used  to  identify  safety  concerns  in  high-risk  procedures 
[10].  They  provide  both  qu  antitative  measures  and  qualitative 
detail  about  the  weaknesses  in  health  care  systems  and 
processes  that  create  inefficiency  and  risk.  When  validated, 
such  specific  data  can  be  used  for  systems  diagnosis  and 
improvement.  This  technique  is  particularly  useful  where  the 
structure  and  organization  o  f  processes  is  highly  variable  and 
heterogeneous  [11]. 

We  aimed  to  analyze  flow  disruptions  during  the  care 
transitions  that  patients  experience  during  trauma  care.  We 
hypothesized  that  more  transitions  would  lead  to  more 
disruptions  and  that  different  pathways  would  have  different 
disruptions. 


2.  Methods 

This  was  a  post  hoc  analysis  of  a  prospectively  collected  data 
set  (Ley  et  al.,  unpublished  data;  Shouhed  et  al.,  unpublished 
data)  obtained  through  direct  observation  during  August, 
September.  October,  and  November  of  2  successive  years. 
Observers  followed  1B1  patients  trauma -activated  patients 
through  the  care  process  at  an  STB -bed  tertiary  Level  I 
metropolitan  nonprofit  academic  medical  center  from  the 
time  the  patient  arrived  in  the  ED  until  the  patient  was 
admitted  either  ta  the  OR,  intensive  care  unit  (IClJ),  or  floor; 
held  for  further  assessment  in  the  ED;  or  discharged.  The 
Cedars -Sinai  Institutional  Review  Board  reviewed  and 
approved  the  study. 

Rese  archers  covered  all  day  and  night  shifts  apart  from  2  AM 
to  E  AM.  We  used  a  sped  ally  adapted  tablet-PC  da  ta  collection 
tool  to  record  timings,  transitions  ,  and  FDs,  which  observers 
categorized  in  real  time  according  to  type  of  FD ;  the  phase  in 
which  the  FD  occurred  [ED.  Imaging  OR,  or  Transition);  and 
a  free -text  description.  Each  entry  was  aka  time-stamped 
automatically  by  the  software.  A  comprehensive  tutorial 
ensured  that  the  observers  who  derived  from  medical  and 
hu  m  an  factors  backgrounds  were  able  to  properly  identify  and 
categorize  FD.  To  ensure  equivalence,  one  researcher  (RE) 
examined  each  FD  post  hoc,  to  exclude  those  that  were  not 
relevant  or  did  not  have  clinical  or  process  significance. 

We  analyzed  each  patient's  record  accardingta  the  specific 
care  pathway  that  was  taken.  We  tabulated  the  frequency 
with  which  different  pathways  were  used  and  the  number  of 
transitions  associated  with  each  pathway.  Although  patients 
undergoing  operations  eventually  were  transferred  to  either 


the  postanesthesia  care  units  or  the  intensive  care  unit  (ICU), 
in  these  surgical  patients  we  did  not  include  observations 
beyond  the  OR  in  the  analysis  ,  because  these  transitions  were 
viewed  as  distinct  tram  those  directly  associated  with  initial 
trauma  care.  As  well,  patients  evaluated  and  discharged  from 
the  ED  did  not  experience  a  physical  tranrition  and  so  were 
excluded  from  further  analysis. 

We  derived  two  basic  performance  measurements:  the 
total  number  of  transitioi  FDs  per  patient,  from  which  we 
derived  the  number  of  FDs  per  transition  per  patient  (i.e., 
the  first  figure  divided  by  the  total  number  of  transitions 
experienced  by  that  particular  patient). 

We  then  examined  the  transitions  that  were  the  highest 
risk  by  calculating  the  mean  number  of  FDs  per  transition  for 
each  of  the  10  patient  pathways  that  were  identified  in  the 
initial  pathway  mapping  this  allowed  us  to  classify  p  atients 
into  “high-risk  transition1'  and  “low -risk  transition"  groups. 
Given  the  heterogeneity  of  the  patient  pathways  and  the 
relatively  law  numbers  af  FD  transitions  encountered,  we 
used  non  parametric  statistics  for  inferential  statistics.  We 
used  the  Mann-Whitney  U-test  to  coup  are  mean  numbers  of 
FDs  between  high  risk  and  low  risk  In  the  final  analysis,  the 
chi-square  statistic  compared  the  frequency  of  disruptions 
between  the  high-risk  and  low-risk  groups.  We  performed  all 
statistical  calculations  using  JMP  9.0.2  (5A5  Institute  Inc,  Cary, 
MC). 


3.  Results 

We  observed  a  total  of  1E1  patients;  Ei.E%  were  transferred  to 
im  aging .  with  BE .  5%  a  f  those  patients  (72 .3%  of  the  total)  then 
returning  to  the  ED,  to  be  held  either  for  further  consultation, 
fer  discharge,  or  far  onward  transitions  to  the  OR,  ICU,  or  the 
floor  (Fig.  1).  We  excluded  21  patients  from  further  analysis, 
including  19  who  were  immediately  discharged  and  did  mat 
experience  a  transition  and  two  additional  patients  who  had 
extrao  rdin  ary  experiences  [one  patient  experienced  six  FDs  in 
transitioning  from  ED  to  Imaging  bade  to  ED,  then  to  the  floor; 
and  another  experienced  eight  FDs  during  a  single  transition 
from  the  ED  directly  to  the  OR) .  These  cases  were  considered 
statistical  outliers,  because  mast  patients  experienced  zero  to 
four  FDs  per  c  ase . 

The  remaining  ISO  patients  experienced  a  total  of  351 
transitions  (mean,  2.2  ±0.09  per  patient),  with  13 experiencing 
c me  transition,  103  experiencing  two,  and  44  experiencing 
three  transitions.  Of  these  patients,  SB  (42.5%)  experienced  at 
least  one  disrupted  transition  during  care,  with  a  mean  of 
0.SS  ±  0.15  FDs  per  patient  and  0.31  ±  0.07  FDs  per  transition. 
Most  FDs  (53%)  were  related  to  coordination  problems  (Fig  2), 
such  as  when  computed  tomography  was  already  occupied, 
the  nurses  on  the  preoperative  staff  did  not  have  the  correct 
paperwork,  the  patient  w  as  taken  to  the  wrong  room,  or  crit¬ 
ical  team  members  were  missing  when  needed.  There  is 
a  small  additive  effect  where  multiple  transitions  equate  to 
a  higher  number  of  FDs  per  patient  [Fig.  3,  bottom  panel),  and 
the  number  of  FDs  per  transition  reduces  slightly  as  patients 
experience  one,  two,  or  three  transitions  (Fig.  3,  tap  panel).  No 
differences  were  observed  to  be  significant 


W81XWH-1 1-1-0813 


Page  53  of  77 


5E3 


JG  TIE  MA.L  Q  ¥  5  U  H  G  TC  A  L  HE  S  E  A  B.CT3  I 5 4  [i  O  1  ^  )  $  fi  &—  5  3  1 


Eitier^ehLv  DepiflraeriL 
n^LSI 


ritAnismaNii 


CuHiiiii#  Room 
n=€ 


Ttisnirvp  Care  UniL 
n»? 


Flpor 

n^fi 


LMthaffie 

ft=19 


rriugir^ 


Fiftiit  SeiCinDdan 

17 

S 

Op-crating  Hanm 

14 

7.7 

icy 

2M 

15.4 

Holding 

S& 

37.7 

blKchargir- 

IT 

20.4 

Nofflf 

34 

is.; 

HiskTrirtsiactfis  (saef^urfc  5| 


IKA^SlllQM 


Opena'tins  Hnon  ^ 
fH 


IflLeSlSlMfi  Car'"  UniL 
n=13  1 


hiKh^rfi^ 

n*IJ 


Floor 

n=0 


EnwjrffPnrv  :Jr-partrrmf 
r-i3l 


HioWing 

n=se 


THANUUDN  2 


p  Djmflnfi  Hoorn  , 


Intersive  Unit 
n-13 


rioor 

— - i- 

n-23 

Cilsct’argi? 

L _ _ J 


2.2tt 

7.25£ 


15  b% 


Fig  1  Transition  pathways, 


The  distribufion  of  results  suggests  that  there  are  clear 
high-risk  arid  low -risk,  patient  experiences  (Fig.  4).  Whenever 
a  patient  goes  directly  Id  the  OR,  or  when  a  patient  needs 
immediate  admission  to  I CU,  there  is  a  higher  risk  of  transi¬ 
tion  disruptions  than  when  patients  go  to  the  floor  or 
discharge,  or  a  holding  area  after  having  Erst  been  to  com¬ 
puted  tomography.  Wilcoxon  signed- ranks  test  confirmed 
a  significant  difference  (Z  =  3.22;  P  =  0.001^  in  the  number  of 
FDs  per  transition  between  high-  and  low-  risk  transitions,  in 
high-risk  transitions,  40%  of  patients  experienced  two  or  more 
tr  ansition  FDs  du  tin  g  their  care ,  as  o  pposed  to  13%  fc  r  low  -risk 
transition  patients  (Table  1).  This  clearly  coincides  WLth  high- 
level  traumas:  .Sicker,  more  urgent  patients  more  likely  expe¬ 
rience  these  nonsLandard  transitions,  and  in  doing  so,  they 
experience  more  FDs.  Using  the  overall  number  of  FDs  per 
patient  and  examining  the  frequencies  of  patients-  with  zero, 
one,  or  two  transitions  (to guard  agauisttype  [error,  given  the 
lower  sample  in  the  high- risk  group),  we  found  a  statistically 
significant  chi-square  statistic  (11.7;  P  =  Q.Q02E),  which 
confirmed  that  there  was  a  significant  difference  be  tween  the 
number  of  transition  FDs  in  low-risk  transition  and  high  -  risk 
transition  groups. 


4.  Discussion 

We  have  demonstrated,  three  key  principles  associated  with 
care  transitions  m  one  trauma  service.  First,  the  vast  maqanty 
of  disruptions  during  trauma  transitions  derive  from  caardi- 
nation  issues  Second,  Siiccesive  handoffsdo  not  necessarily 
increase  the  number  of  transition  FDs.  Fin  ally,  some  patient 
pathways  are  at  a  demonstrably  higher  risk  of  transition  FDs. 
Patients  who  are  taken  directly  to  the  OR  or  need  immediate 
[CD  care  are  far  more  likely  to  experience  multiple  disruptions 
during  care  transitions  than  ace  those  who  follow  a  more 
sLandard  and  less  time-pressured  pathway,  [n  essence,  the 
sickest  patisits  who  need  the  mast  rapid  and  specialized 
treatment  are  most  at  risk  tram  coordination  and  other 
problems  during  their  transitions  to  different  care  teams  and 
locations. 

By  and  large,  about  one  in  every  two  high-risk  transitions 
experiences  a  disruption,  compared  with  about  one  in  every 
five  low-risk  tra  nations.  Clearly,  this  is  partly  an  effect  of 
patient  complexity  and  time  pressure,  [n  particular,  sick 
patients  m ay  need  in  be  moved q uickly ,  which  increases  the 
chances  of  errors  or  omissions  during  the  transition.  There  is 
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ftg.  2  Flow  disruption  types.  {Color  version  of  figure  is  available  online.} 


presumably  also  an  effect  of  familiarity.  After  initial  assess¬ 
ment  LD  EE],  nearly  three  quarters  of  patients-  go  to  imaging, 
and  then  return  to  the  ED.  The  cases  that  do  not  fallow  this 
route  are  Lite  ones  most  prone  to  disruptions.  Thus,  the  need 
to  conduct  complex  transitions  with  sick  patients,  under  time 
pressure,  using  a  non-routine  pathway,  leads  to  distinzt 
coordination  challenges  that  result  in  these  disruptions  The 
implications  for  mass  casualty  events  are  potentially  more 
severe,  because  these  higjii- risk  pathways  are  likely  to  be  fre- 
q  ue ndy  used  with  pa  Qen  ts  with  a  higher  de  gree  o  f  uncer  tain  ty 
a  nd  more  seve  re  in  j  u  ries ,  with  a  bighe  r  E  D  wo  rklo  ad .  and  with 
a  limited  number  of  available  staff  and  equipment  [12].  All  of 
this  further  illustrates  the  value  of  employing  these  methods 
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Fig.  3  flow  disruptions  pe  r  transition  (top}  and  per  p  atie  nt 
(bottom).  (Color  version  of'  figure  is  available  online.} 


under  such  considerations,  simulations,  or  assessments. 
■Coordination  fails  just  when  you  need  it  to  work  the  best. 

These  finding-  contrast  with  most  published  ban  doff 
investigations,  in  which  the  empha-as  has  been  on  the  stan¬ 
dardization  of  discrete  handoff  processes  to  improve  commu- 
nicadon  of  information.  Clearly,  the  non -routine  transitions 
with  sequences  that  are  less  discrete  and  normalized  access 
patients  are  most  at  nsk  of  coordination  problems.  There  is 
therefore  a  need  to  consider  haw  to  enhance  coordination  in 
urgent,  time -pressured,  rion -routine  transitions.  In  a  previous- 
study,  a  multidimensional  handoff  process- was  implemented 
for  bigh-r£$k  surgery  patients-,  based  on  praedees  in  aviation 
and  motor  racing  [13,14],  Improved  b  sndo  if  performance  was 
demonstrated. 

T able  2  illus  tr  ates  how  a  s  imilar  a  pproach  might  be  a  pplied 
here.  Opera  Lion  alizuig  tlsese  adaptations  would  involve 
several  stages  of  development,  LesUng,  and  modification  [15]. 
■Consistent  applicadon  might  be  furthered  by  Use  of  context- 
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Fig.  4  High  tlb  k  and  low-risk  tra  nsitions . 
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1  Table  I  —  Frequency  distribution  of  traimtion  FDe,  I 

N 

ETJs  per  patient(n  \%\} 

AH 

High-level  traumas 

0 

1 

2 

3 

4 

Hi jji-  risk  transitions  2S 

H  fiO) 

11  {29) 

5(1E) 

9(32) 

2(7) 

iW 

Low^risk  transitions  LE 

10(75) 

3:2(62) 

10  B) 

5(4) 

1(1) 

sensitive  in  forma  tion  technology  took  La  manage  the  process , 
information,  arjti  communication  with  Lhc  many  care  ’(enu.es 
(imaging,  OR,  and  the  ICU]  [16,17],  We  are  currently  exploring 
die  former  and  developing  the  latter,  and  hope  to  implement 
a  range  of  changes  over  the  coming  months,  to  pa  ten  tidily 
include  checklists.  process  simplification,  teamwork 
improve  men  ts,  and  careful  application  af  information 
tech  nology. 

Transitions  from  the  ED  are  among  the  most  complex 
ha  n  doffs  in  health  care,  with  a  highly  variegated  papulation  af 
patients  and  care  givers.  This  study  supports  our  belief  that 
there  need  to  be  more  thorough  examinations  of  such  un¬ 
der  appreciated  risk  situations.  That  said,  this  was  a  relatively 
small  sample  within  a  single  hospital.  Et  is  not  dear  whether 
these  results  would  generalize  to  a  wider  papulation.  Also,  we 


Table  2  -  Imprawment  tkatid  from  aviation  and  motor 

rtrm|. 


Im  p  ro  ve  men  L 
theme 

Practice 

leadership 

Designating  a  d*ar  leader  tou  die  transition 
process  mil  assist  appropriate  manajp-ment 
of  the  process 

Task  seqi^nce 

daiiiy  of  the  aide  -of  tasks  that  rieed  to  be 
completed 

Task  allocation 

Ckuiiy  of  rotes  and  res  pons  laities  for  die 
transition  pmn^w ,  ens  mij  ig  all  tasks  will  be 
completed 

Predicting  and 

lie  in.,  able  to  think  altad  and  prepare  tor  Lire 

planning 

non- routine  transitions 

Dkdpline  and 

Even  ur  stressful,  high-risk  cases;  the  ability  ro 

composure 

remain  calm  is  essejitel 

Checklists 

Urease  can  ass  is  t  in  routine  sit  nations  but  may 
be  particularly  useful  in  non- routine 
ii  tuatious,  where  it  J  iii  g.l  i  l  be  eeay  to  far  get  key 
tasks 

Involvement 

□sing  everyone  available  to  assis  t  in  d  ie 
transition  basks,  -spec  telly  i  n  Identifying  risks 
or  omitted  tasks 

Briefing 

Spend  30  s  piepjj  ing  tire  team  f_.j  ahiglt-r  ek 
transfer ,  ensuring  all  tasks  are  done  aiti  all 
team  menisets  are  fully  aware  of  what  is 
happening 

Situation 

“lie  most  ex  per  ten  cal  team  member  stands 

awareness 

bad:  and  monitors  tire  transit  bn  process,  and 
tes  ponds  quickly  Lo  piosbkjus 

Training 

Drills  and  practice  in  transitions  could  Le 
taught  in  induetbn  or  in  brief  in  situ  training 
simulations 

KjP/ieiV 

Discussion  of  problematic  ti  ansi  ticuts  after  d  ie 
case  or  a i  die  men  tidy  performance 
improvement  comm  ittees 

were  unable  to  study  patients  who  were  transferred  from  the 
OR  to  ECU  because  of  the  limitations  of  observ ation  and  the 
dataset.  Fu  rthe  rmo re ,  in  this  s  tudy ,  we  e valua  Led  only  FDs ;  we 
did  not  examine  teamwork,  the  communication  of  informa¬ 
tion,  or  the  working  environment,  all  of  which  are  frequently 
the  focus  of  other  published  hand  off  work;  nor  were  we 
able  to  study  whether  any  adverse  events  arose  from  our 
obse  rvations. 


5.  Conclusions 

Transitions  of  care  for  trauma  patients  are  prone  to  disrup¬ 
tions.  Coordination:  problems  predominate  as  the  cause.  1 1  is 
the  sicker,  more  Lime -pcessu  red,  more  at  risk  patients  who  are 
more  likely  to  experience  disruptions;  direct  transitions  to  the 
OR  or  ECU  are  associated  w'ith  higher  numbers  of  disruptions. 
System-based  solutions  reflecting  lessons  lear  ned  in  other 
industries,  may  be  helpful. 
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IMPO  RTANCE  A  physician -centered  approach  to  systems  design  is  fundamental  Do  Snaajr.gerycQm 

ameliorating  the  causes  of  smapy  errors,  inefficiencies,  ard  rdiabdity  pr  oblems. 

QGJ  ECTIVE  To  use  huma n  factors  engineering  to  redesign  due  trauma  process  based  on 
prewously  identified  impediments  to  care  rdaDed  to  ccetdination  problems  communication 
failures,  and  equipment  issues. 

DESIGN,  SETTING,  AMD  PAHTSO  PANTS  This  study  used  an  interrupted  time  series  deagn  to 
Golbed  hssteiic^ly  controlled  data  via  prospective  direct  observation  by  trained  observe  "s. 

We  studied  patients  from  a  levd  I  trauma  centEff  from  August  1  through  October  31r  2011,  and 
A_gpst  I  through  October  3f,  2012. 

INTEffVEMTlCKNS  A  range  of  potential  solutions  based  on  previous  observations.  trauma  team 
■engagement,  and  iterative  cycles  identified  the  most  promising  subsystem  interventions 
fhBadsetSr  equipment  storage,  medication  pocks,  whiteboard.  prePriefing,  and  teamwork 
trainings.  Five  of  the  6  subsystem  irrterven Cions  were  successfully  deployed.  Communication 
headsets  were  found  to  be  unsuitable  in  simulation. 


MAIM  OUTCOM  EB  AMD  MEASURES  The  primary  out  come  measure  was  Flow  disruptions,  with 
treatment  time  and  tength  of  stay  as  secondary  outcome  measures 


RESULTS  A  total  of  8&  patients  were  observed  before  the  intervention  and  120  after  the 
intervention.  Ftow  disruptions  increased  if  the  patient  hedundergonecornputedtomcigraphy 
£CT)  CFcoo  "  3QuOrP  c  .001)  and  had  been  to  the  operating  room  (F^sqq  -  63.1,  P  <  .001),,  with 
an  interaction  among  the  intervention,  trauma  level,  andCT  £F|2oq  “  ‘S-50,  P  -  .01).  For  total 
treatment  time,  there  was  an  effect  of  the  intervention  (F-^oo  -  217,  P  <  .00  r>,  whether  the 
patient  had  undergone  CT  -  43.0,  P  <  JOOl),  and  whether  the  patient  had  been  to  the 
operating  room  (F1200  "  E5.B,  P  ■=  JQOh,  with  an  interaction  among  the  intervention,  trauma 
level,  andCT  -  1SJ,  P*  .001),  reflecting  a  20-  to  30-minirte  reduction  in  time  in  the 
emergency  department.  Length  of  stay  was  reduced  significantly  for  patients  with  major 
mortaSty  re*  (P  -  .01)  from  a  mediae  of  3  to  S  days. 
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R search  Crenel  nvesti^iion 

Application  of  human  Factors  engineering  principles  in 
tiauma  care  may  reduce  flow  disruptions 4FDsJ,  treat¬ 
ment  time,  and  Length  of  stay.  In  health  care,  uninten¬ 
tional  harm  is  Frequent1'-  and  often  caused  by  faulty  systems 
that  allow  errors  to  perpetuate,  permitti  ng  i  njury  to  occur. t 
Rather  than  Focusa^gsnielyon  who  made  an  error,  a  systems 
analysis  of  how,  when  r  where,  and  why  errors  occur  provides 
a  window  through  which  it  is  possible  to  understand  the  weak¬ 
nesses  of  the  modem  health  care  provis  ion  process.  ®  As  with 
many  other  specialties,  trauma  caret>enefit5  from  studies  oF 
safety,  quality,  efficiency,  and  error. 

Human  Factors  engineering  is  based  on  the  principle  that 
system  performance  and  human  well-being  can  be  improved 
through  an  integrated  approach  to  individual  shills,  team¬ 
work,  equipment,  task,  environment,  and  organizational 
design. '  Considerable  evidence  supports  Lm proving  work  sys¬ 
tems  through  interi'enliGusmch  as  checklists,*8  briefings, ■*iLU 
standardized  care  pathways,1'  formal  protocols.1-  team  re¬ 
source  management  training,11  and  technological 
development' 1  tc  improve  teamwork,  shared  knowledge,  work¬ 
flow.  and  outcomes.  The  greatest  successes  are  usually- 
achieved  by  involving  physicians,  numes.  and  ether  practi¬ 
tioners  in  the  process  ofde velopir.g  improvements1^ and  by 
designs  ng  systems  around  human  needs. This  person- 
oentered  approach  to  systems  de  sign  is  fundamental  to  ame¬ 
liorating  the  causes  oF  many  errors,  inefficiencies,  and  reli¬ 
ability  problems. ,B 

Previous  studies-'1--*  have  sought  to  use  human  facto  is  en  - 
gjneering  to  redesign  thE  trauma  process  using  a  mul  tidisci- 
plinary  team  of  experts  in  process  improvement,  human  fac¬ 
tors  research,  and  trauma  care.  To  identify  key  areas  for 
improvement  of  our  trauma  s  ystem.  Elocker  et  alIH  and  Catch  - 
pole  el  a!*11  prev  iously  conducted  process  mapping,  inter¬ 
views,  safety  culture  ques  tionnaires,  and  direct  observation 
of  FD&aitd  process  timings.  fTcw  desru  prions  are  defined  as  "de¬ 
viations  from  the  natural  progression  of  an  operation  thereby 
potentially  compromising  the  safe  Ly  of  the  operation’- 
and  have  been  empirically  linked  with  surgical  errors.  The 
study  ofFDs  has  helped  identify  systems  problems  in  a  vari¬ 
ety  of  other  long-term  care  dlnical  settings. Within  our 
trauma  system,  the  most  common  FDs  were  coordination  prob¬ 
lems.  communication  Failures,  and  equipmen  t  issues,  with  sig¬ 
nificantly  higher  numbers  and  rates  of  disruption  in  the  com  - 
puted  tomography  (CT>  imaging  room  and  the  operating  room 
(OR).  These  FDs  were  observed  most  frequently  in  more  seri¬ 
ously  injured  patients. Jfi 

This  total  systems  analysis,  combined  with  theoretical  and 
practical  expertise,  generated  a  range  oF  task-,  team-,  envi¬ 
ronment-.  and  equipment -related  solutions.  We  hypoth¬ 
esized  that  each  could  be  individually  effective  and  toget  her 
would  reduce  FDs,  reduce  treatment  time  w  ithin  the  first  hour 
of  patient  care,  and  reduce  length  of  stay. 


hLrnsn  FkIot  SlIe^ote  in.  Triumn  Ci»e 


Methods 

Ethics 

All  data  coilection  studies  were  individually  reviewed  and  ap¬ 
proved  by  the  ins  titutional  review  board  of  the  Cedars-Sinai 
Medical  Center  and  the  US  Army  Medical  Research  and  Mate¬ 
riel  Command  Human  Research  Protection  Office.  Given  that 
it  was  not  possible  ibr  patients  to  consent  to  be  pert  cf  the  study, 
this  requirement  was  waived  by  the  institutional  re viewboard 
with  the  stipulation  that  no  patient  details  were  to  be  re¬ 
corded.  This  prevented  the  direct  comparison  ofobserved  treat- 
men1!  and  outcomes  hut  still  allowed  the  use  of  deidc-ntified 
hospital-  collected  outcome  data. 

setiireg 

The  study  was  con  ducted  at  a  >>&a-bed,  nonprofit,  academic, 
tertiary  care  medical  center  with  more  than  iQOCi  annual 
trauma  activations  within  the  level  1  trauma  center.  The  emer¬ 
gency  department  (ED)  was  staffed  and  managed  by  ED  phy¬ 
sicians,  nurses,  and  technicians.  The  trauma  service  con¬ 
sisted  of  6  attending  physicians,  2  trauma  and  critical  care 
fellows,  and  4  surgical  residents.  The  trauma  team  w  as  acti¬ 
vated  by  the  mobile  intensive  care  nurse  after  a  radio  call  was 
received  from  emergency  medical  services  that  provided  the 
detadsof  an  inbound  pa  tienL  The  mobile  intensivecare  nurse 
activated  a  pager  system,  which  displays  the  trauma  level  (high 
or  low  acuity),  after  which  the  trauma  team  assembled  in  the 
ED,  The  hospital  already  had  a  dedicated  performance  im¬ 
provement  and  organizational  change  team.,  bu  t  Lhey  were  not 
directly  involved. 

study  Design 

This  study  had  an  interrupted  time  series  design  that  used  his¬ 
torically  controlled  data  collected  via  prospective  observa¬ 
tion  of  FDs .  The  primary  outocme  measure  was  FDs.  with  treat¬ 
ment  time  and  length  of  stay  as  secon dary  ou  toome  measures. 
Seven  human  factors  researchers  and  medical  students  with 
training  in  human  factors  collected  prospective  observa¬ 
tional  data  from  trauma  patients  during  the  iG-week  preinter¬ 
vention  and  postintervention  phases  From  August  L  through 
October  31, 201 1,  and  August  i  through  October  lir  2012,  re¬ 
spectively.  They  observed  the  trauma  care  process  from  the 
time  the  patient  arrived  in  the  ED  uo  ti  l  the  patient  was  admit¬ 
ted  to  the  main  hospital,  admitted  to  the  intensive  care  unit, 
held  in  the  ED  for  Further  consul  ta  lion,  -or  discharged  home.^ 
Observations  were  conducted  in  multiple  trauma  bays,  CT 
imaging  rooms,  and  ORs  within  the  hospital  while  Following 
up  the  patient.  En  general  use  for  trauma  patients  were  4  hays 
in  the  ED.  2CT  ima^ng  rooms,  and  2  ORs,  although  others  were 
available,  and  no  reoord  was  taken  of  which  were  used.  Events 
that  dismpted  the  flow  of  the  trauma  care  process  were  col¬ 
lected  using  a  tablet  personal  computer  data  collection  tool,*0 
which,  provided  the  total  number  of  FDs.  Entry  and  exit  times 
For  the  FJ3,  CTimaging  room,  and  OR  were  also  recorded,  which 
allowed  treatment  times  and  FD  rates  to  be  calculated.  Mul¬ 
tiple  trauma  teams  were  observed  throughout  die  observa¬ 
tion  period.  Team  members  came  from  a  pool  of  6  trauma  sur- 
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Flgifipe  1.  Desl^i  of fte  ML#fltompanent  interveratfcm 


geans  and  £  or  more  residents .  Because  teams  were  com prised 
oF  an  ad  hoc  group  and  rarely  the  same,  the  number  of  differ¬ 
ent  teams  observed  was  a:  Least  12  within  the  cure  trauma  team , 
with  many  more  permutations  when  taSrii^g  into  consider- 
ation  the  sup  penning  ED  and  technician  members. 

To  assess  Lmesrate:  reliability.  La  iranma  patten  ts  had  2  ob¬ 
servers.  whose  responses  were  compared  using  a  Cronbadi  a 
test.  Data  were  obtained  ficmihe  University  He  a  St  he  are  Con¬ 
sortium  database  For  all  trauma  patients  during  the  premier 
ventinn  and  postintervention  phases  . 

Design  and  Deployment  of  inLerventlofis 
Analysis  of  FDs  sugges  ted  that  communication  and  coordina¬ 
tion.  leadership  and  teamwork,  pattern  Factors,  and  equip¬ 
ment  issues  could  benefit  From  targeted  interventions.  Data 
gathered  From  interviews  found  that  coordination  and  proto¬ 
col  deviations  were  common  causes  of  finis Oration j  antervie- 
weesespressed  some  conFusion  over  leadership.  The  FDs.  par¬ 
ticularly  in  the  form  of  superfluous  noise,  reduced  the  amount 
oF  information  transferred  among  team  members.  Role  con- 
fission  was  reported,  especially  with  task  sharing  and  leader¬ 
ship  between  the  ED  and  trauma  staff. 

Having  collected  and  analyzed  the  FD  data,  a  multidisci¬ 
plinary  team  that  oonsistedof  8  phy  sicians  [including  E.L.,  E  JG-. , 
A.G..  and  D.S.?,  6  human  factors  scien  lists  [indud  ing  K.C..  D.W., 
and  H_  B.i,  U  curses,  and  2  health  care  improvement  ck ports  (in¬ 
cluding  J.B.  >  was  brought  together  fa:  one  and  a  halfdays  to 
define  problems  and  identify  solutions.  The  main  problem 
areas  were  identified,  and  a  range  of  potential  solutions  to  each 
weregenerated.  Then,  a  short  list  was  generatedbased  on  prac¬ 
tical  considerations  or  the  projected  time  needed  For  imple¬ 
mentation.  This  short  Lis  t  was  Framed  within  the  components 
of  the  Systems  Engineering  in  Patient  Safety  human  Factors 
model.'’  which  also  assisted  i  n  down-selection,  to  ensure  cov¬ 
erage  of  task,  team,  environment,  and  technology.  After  the 
meeting,  members  of  the  ED  and  trauma  teams  were  invited 
to  discuss  theshert  list  and  be  invoked  in  the  studies.  As  imple¬ 
mentation  moved  forward,  we  used  small,  iterative  plan-do- 
s  Ludy-act  cycles  to  develop  each  interveni  ion  to  a  level  where 


it  was  practical  and  deliverable  .  We  then  developed  effective¬ 
ness  and  uptake  measures,  followed  by  full  deployment  of  the 
interventions  hum  May  2  through  September  3,0,  MU.  Figure  t 
illustrates  the  general  process  by  which  the  Interventions'  were 
developed,  with  the  rationale  and  implementation  strategy  in 
eTable  s  in  the  Supplement. 

Observational  measu  res  of  the  uptake  oF  each  subsnter- 
vantion  were  used  to  gauge  the  effectiveness  of  the  white¬ 
board,  prebriefing,  and  teamwork  behaviors  [eTable  i  and 
eTable  2  in  the  Suppkmenri.^^Si*  ty-nine  patientsin  the  post- 
intervention  phase  were  studied  with  an  additional  observer 
who  used  an  observation  template  that  collected  a  range  of 
measures  to  ascertain  the  use  of  these  interventions.  Fnr  the 
other  interventions,  appropriate-evaluation  methods  weiecho- 
sen  to  demonstrate  effectiveness  ot  uptake.  All  intervention 
evaluation  metrics  are  summarized  in  eTable  2  in  the  Supple¬ 
ment. 

StaUsclcal  Analysis 

All  da  ta  were  posi  tively  skewed  so  means  (SDs)  and  medians 
Granges)  were  calculated.  For  statistical  analysis,  the  Log- 
transforma  don  Function  wee  used,  which  generated  a  more  ap¬ 
propriate  distribution  for  parametric  analysis.  The  main  ob- 
5? rva  Lion al  data  (treatment  times  and  FDs?  were  studied  in 
stepwise  multivariable  linear  regression  models,  which  took 
into  account  intervention  period,  trauma  level  (high  orlowl, 
whether  the  pattern  had  been  to  the  CT  imaging  room  and  the 
OK,  and  interaction  among  theinterventicn.  trauma  level ,  and 
CT  imaging  room.  For  patient outcome  data  (length  of  stay  and 
intensive  care  unit  stay),  separate  before -and -alter  compari¬ 
sons  were  made  with  Eruskal- Wallis  tests  for  each  risk  of  mor¬ 
tality  estimate  (minor,  moderate,  major  or  extreme ;  as  de¬ 
fined  in  the  University  HealthcareConsartsum  database). 
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Flgue  2.  Flow  Disruptions  Sri  Computed  Renography  (CT'I 


Figure  3.  #lme  in  the  Emergency  DqieiliTient  (EO!' 
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Results 

Deployment  of  Subsystem  'nterventlons 
Five  of  the  6  subsystem  interventions  were  deployed.  AJI  de¬ 
ployed  interventions  were  measured!  asbeingeFFectively  used 
to  some  degree,  although  reliabili  ty  d  iffered.  Ali  intervention 
evaluation  me  tries  are  summaiizedin  eTable  2in  the  Supple¬ 
ment.  The  equipment  storage  standardization  provided  time 
and  movement  benefits.  Although  ibe  transport  medication 
pack  was  rarely  used,  the  presence  of  the  guidance  provided 
extra  benefits.  The  whiteboard  was  used  and  completed  in  a 
timely  manner  in  70^  of  cases  and  usually  had  all  key  infor¬ 
mation  documented.  There  was  noS  alwayssufficient  time  to 
conduct  a  pretrauma  briefiiig.  and  the  variable  amount  of  time 
available  to  the  team  was  a  dear  limitation,  hut  anecdotal  sub¬ 
jective  views  were  positive.  The  teamwork  I  raining  was  well 
received  and  resulted  in  significant  improvements  in  ob¬ 
served  teamwork  and  explicit  teamwork  behaviors. 

Direct  Observation  Sampling 

In  the  p  re  intervention  phase..  patients  were- oh  served.  In  the 
post  intervention  phase.  L20  patients  were  observed  (from 
which  the  GQ  patients  used  for  effectiveness  evaluation  were 
also  taken'1.  The  samples,  results,  and  statistical  modeling  are 
provided  in  eTables  3,4rand  tin  the  Supplement.  The  11  dual - 
observed  patients  had  aCronbach  oofo.-B^G.  indicating  good 
in  temal  consistency. 

For  FDs  in  high -acuity  patients,  there  is  a  reduction  in 
mean,  median,  and  rar^.  The  FDs  in  lower-acuity  patients  had 
a  reduction  in  range.  Taking  the  Sogju  of  the  FD  total  to  ad¬ 
dress  skewness,  FDs  ir*  =  0.31  S  increased  iFthe  patient  had  been 
to  the  CT  imaging  room  i.Fajllt.  -  20.d:  P  •-  ,001)  and  the  OH 
-  63- L  P  *  -DOl),  with  an  interaction  among  the  inter¬ 
vention  ,  tmuma  level,  and  CT  (FlJU,,  =  6.50,  P  ■:  .0i>.  This  find¬ 
ing  reflects  the  pa  rticulaT  benefit  for  high-acuity  patients  un  - 
dergoing  CF  ■;  Figure  2>. 

For  total  treatment  time,  there  was  a  significant  effect  oF 

the  intervention  (F _ -  21.7,  P  ■=  .001)  if  the  patient  went  to 

the  CT  imaging  room  {F1U^  •  -Id  0,  P  <  .001)  or  the  OH 
^  .OQs),  with  a  si^ificant  interaction  among  the 
trauma  level,  CT,  and  the  intervention  C F1JuC.  =  iS-l,  P  r;  .udij. 
Figure  3  shows  a  mean  2u-  to  3d- minute  reduction  in  time  spent 
in  the  ED. 


Enar  bara-Tdrai:  95%  Ck. 


Length  of  Slay 

Length  of  stay  and  intensive  care  unit  stay  data  were  col¬ 
lected  For  Eld  surgical  and  trauma  patients  before  the  inter¬ 
vention  and  5dS  after  the  intervention.  Mean  length  of  stayby 
mortality  risk  is  shown  in  Figure  4-  The  Kmskal- Wallis  tests 
revealed  a  significant  difference  in  length  of  slay  for  patients 
at  major  mortality  risk  (74  before  and  69  after,  a  =  -2.49, -F  =  -dt) 
but  no  other  effects.  Median  length  of  stay  decreased  from  S 
days  in  the  pre-intervention  phase  to  5  days  in  the  postinter- 
vention  phase. 


Discussion 

Interventions  basedon  detailed  human  Factors  engineering  and 
sys  bams  analysis  of  trauma  care  provision  led  to  measured  ben¬ 
efits,  including  reduced  FDs,  treatment  time,  and  Length  of  stay. 
We  built  on  previous  5 ingle- intervention  studies^by  imple¬ 
menting  a  combination  of  interventions  to  address  several 
problems  from  multiple  perspectives.  Improvemen  ts  were  de- 
signed  to  address  the  broad  range  of  barriers  to  effective  care 
identified  by  our  prior  systems  analysis,  Physician-centered 
conrideiations  and  iterative  approaches  werebrought  loaQ  the 
interventions  developed  to  engage  a  nd  adapt  our  solutions  to 


Figure  4  length  of  Stay  flask  of  Mor&ifly 
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local  requiremen  ts  and  system  complexity.  Although  many 
studies1'  11  exhibit  complex  system  safety  interventions,  far 
fewa^  have  attempted  change  of  multiple  dimensions,  and 
even  fewer1*  have  evaluated  improvement  and  the  greater 
wphole.  Forexample,  in  2  paiticulaily  well-iu^rded  studies..''1* 
the  multiple  intervention  dimensions  used  have  only  emerged 
subsequent  to  the  main  findings,  '*•  which  has  resulted  in  rep¬ 
lication  problems.  *■  lTTo  our  In  owl  edge,  although  teamwark- 
level  human  Factors  studies  in  trauma  care  abound,  th  is  ccm- 
prehensive  systems-level  human  factors  analysis  and 
intervention  has  never  been  previously  attempted  in  trauma 
care. 

Given  that  the  reductions  in  FDs  did  not  suggest  a  strong 
effect  size,  the  reduction  in  ED  time  and  the  I  ength-of-stay  ef¬ 
fects  are  perhaps  mure  surprising.  This  length  uf  stay  was  not 
compared  with  a  non  treatmen  t  control  group,  and  we  were  un¬ 
able  to  Hack  individual  patients  ihrnugh  their  entire  cate  and 
thus  were  unable  to  directly  reJateuutromes  toouT  study  popu¬ 
lation.  However,,  there  are  a  number  of  reasons  to  consider  this 
outcome  as  a  result  of  some  importance.  First,  we  were  care- 
fid  to  select  similar  periods  and  similar  patient  populations. 
Second,  although  all  interventions  were  not  used  all  the  time, 
st  is  likely  that  they  were  deployed  in  the  trauma  patients  we 
did  not  directly  observe  in  simillaT  proportions.  For  example, 
the  teamwork  training  presumably  benefited  all  trauma,  pa¬ 
tients,  not  just  those  we  observed,  whereas  the  briefing  was 
well  received  and  the  whi  teboard  was  used  i  ndependently  of 
our  studied  patients.  Third,  our  process  changes  wen?  most 
beneficial  for  the  higher-risk  patients,  as  evidenced  in  the 
length -of-stay  and  FD  findings.  Finally,  the  reduction  in  ED 
time  is  a  reflection  of  the  well-observed  value  in  the  provi¬ 
sion  of  early  effective  trauma  care.  We  suspect  that  this  time 
benefit  is  associated  with  the  small  reduction  in  FDs  and  fur¬ 
ther  additional  interventional  benefits  that  were  not  directly 
measured.  Forexample.  when  teamwork,  comm  unication,  and 
coordination  are  improved,  we  might  expect  improved,  deci¬ 
sion  maldng.Hn  faster  response  toCTand  OR  procedures/*  and 
better  ability  to  provi  de  more  effective  and  1  imely  care  rather 
than  simply  the  avoidance  of  FDs. 

]|  is  worth  noting  that  a  proportion  of  FDs  m  ay  be  advan¬ 
tageous  (eg,  there  maybe  a  coordination  advantage  in  minor 
pauses  07  timeouts)  and  that  skilled  teams  are  able  to  use  such 
pauses  tc  prevent  adverse  effects  on  patients  This  context 
also  provides  further  support  for  the  strength  of  the  Lime  and 
length -of-stay  effects  over  the  reduction  in  FDs  themselves. 
Thus,  al  though  a  mul  tisite  controlled  study  would  be  needed 
to  confirm  these  results,  we  believe  the  presen  t  results  are  suf¬ 
ficient  to  indicate  the  value  of  such  an  endeavor. 

We  also  measured  t  he  effectiveness  and  uptake  of  all  our 
subsystem  interventions,  affording  extra  detail  regardi  ng  the 
mechanism  and  replicability  of  overall  effects.  Al  though  not 
all  subsystem  in  ter vent  ions  were  used  all  the  tame,  most  were 
used  effectively  most  of  the  time.  This  variation  in  use  is  a  re¬ 
alistic  part  of  system  Function  and  suggests  that  the  presen  t 
study  is  a  conservative  estimate  of  the  benefits  of  this  type  of 
whole  systems  approach  if  greater  reliability  can  be  achieved. 
In  this  analysis,  we  did  not  test  the  contribution  of  the  inter¬ 
ventions  individually,  instead  seeking  to  examine  the  overall 
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effect  of  the  combination  because  the  evidence  for  each  was 
sufficient  alone,  whereas  no  studies,  to  our  knowledge,  have 
examined  multidimensional  human  factors  interventions.  The 
subsystems  approach  is  an  exampleofhow  improvements  that 
address  multiple  dimensions  of  team  (training),  task  (brief¬ 
ing),  equipment  (medical  transport  packs),  and  environment 
(equipment  storage  standardization)  may  be  more  effective 
than  focusing  on  one  dimension.  ''-  ^  In  particular,  the  typical 
focus  in  health  care  improvement  on  training  and  other  meth¬ 
ods  of  direct  behavioral  change  are  limited  bu  t  frequent]  y  de¬ 
ployed  even  though  other  system  considerations  might  also 
offeT  performance  benefits. As  a  final  observation,  al¬ 
though  our  approach  afforded  a  complex  systems  analysis  and 
an  expert  team,  the  underlying  themes  of  our  interventions 
that  emerged  were  simplification,  teamwork,  and  integration 
and  management  ofinformaticn. 

Thisstudy  was  not  masked  because  the  interventions  were 
overt.  Observers  were  not  masked  to  the  interventions  bu  t  had 
not  been  extensively  involved  in  their  development  and  imple¬ 
mentation,  and  in  some  cases  they  may  have  been  unaware 
(only  R.B.  wFas  part  of  the  project  teamj.  The  observer  who  re¬ 
corded  th? effect 5  oflhe  interventions  was  more  involved  with 
the  intervene  ions  and  thus  aware  of  the  changes  that  had  been 
made  but  was  not  directly  involved  in  theirgeneraticn  os-  imple¬ 
mentation  and  was  provided  with  a  strictly  structured  set  of 
items  tn  score.  We  also  cannot  ignore  (he  Hawthorne  effect. 1  * 
However,  ihe  presence  of  observers  was  largely  unobtrusive 
and  identical  in  tbe  premier  vention  and  pos  lint  erven  I  ion 
phases.  In  addition,  previous  experiences  suggest  that  their  in¬ 
fluence.  at  least  in  the  OR,  does  not  preclude  the  observation 
of  system  problems/1”*7  In  terms  of  sampling,  there  was  a  dif¬ 
ference  in  the  eve  rail  sample  sizes  in  the  preintervention  and 
post  i  ntervention  phases,  although  in  the  high-acuity  pa¬ 
tients,  in  whom  the  most  benefits  were  observed,  there  is  near 
parity  (sample  sizes  of  74  and  in  the  preuitervention  and 
pas  tin  lenient™  phases,  respectively^ 


Conclusions 

This  is  the  first  study,  to  our  knowledge,  tc  objectively  exam¬ 
ine  the  effects  of  multiple  subsystem  interventions  in  trauma 
care.  The  detailed  study  of  the  trauma  system  and  the  collec¬ 
tion  of  data  prospectively  were  central  in  guiding  us  toward 
the  largest  improvement  opportunities.  By  reviewing  hospi¬ 
tal  policy  documentation,  we  mapped  the  process  and  core 
ducted  interviews  and  focus  groups  with  a  bread  range  ofphy- 
sidaus  to  discover  (he  iT  impressions  of  the  problems.  Using  the 
hu  man  factors  and  systems  performance  improvement  meth¬ 
ods,  we- collected  data  on  the  entire  trauma  process.  Through 
a  combinationofstatisticaL  analysis  and  multidisdplinary  con¬ 
sensus.  we  identified  key  aspects  of  process,  workplace  modi¬ 
fication,  teamwork,  technology,  and  information  manage¬ 
ment  that  would  benefit  from  reengineering.  By  piecing 
together  all  the  collected  data  elements,  we  were  able  to  tar¬ 
get  our  inter  ventions  to  have  the  greatest  positive  effect  on  the 
process.  These  interventions  were  developed,  integrated,  and 
evaluated  for  their  relevance  and  effectiveness.  This  earlystudy 

JAMA  Surgery  Printed  odineAi^iA  6.2014 


W81XWH-1 1-1-0813 


Page  62  of  77 


RBWrtJl  Cr^Elr^l-SrTVEt^aiDn  hunm  Firtocs  SLtEystra-s  in  Trauma  Cire 

in  a  complex  field  suggest5  benefits  in  red  tired  FTDs,  reduced! 
treatment  time,  and  the  potential  for  seduced  length  of  stay: 
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ABSTRACT 

When  bantine  ititt  do  oat  adho?  to  pa  ae^ 
ijratoco  s,  or  cJiedc  ats,  nuiagen  att©i  regard 
tese  vo  at  ore  as  -:>i:cat.  rg  poo"  practce  or 
weri  oeg  geroe-.  Mots  atteo  than  r-ot.  howwei; 
t-eae  po  'ey  ar*d  protocol  voatons  det  ect  toe 
ettohs  ot  we  rtenboned  protesE  ona  s  to  car-y 
out  V&'r  wor<  etfksaitjy  o  tfe  face  ot  ayst^a 
peer  y  deagned  to  nreat  tied  vsee  de-maids  ot 
pat  ©it  ere.  To  oao-comp*  a  nee  walfi 

TEttutona  po  ces  ©id  protocol  often  -sgnaaa 
systems  petem,  rather  tha  n  a  peco  e  p*db  e^r 
arid  can  te  of  jeoced  among  atneT  tbmqp  try 
taming,  compel  ng  goati.,  canted,  process, 
oca  ton,  case  comp  ecty,  -d  vdua  oe-sfc,  the 
direct  or  'ndE^ct  riftueoce  ot  otners  job 
pressure ,  ftexb  ry,  nxe  detrn  fan,  a  nd  c'n  c  an- 
centred  deagn.  Tmee  candidates are  cons  deTed 
for  deveOoTig  a  nnodd  ot  satety  benavour  and 
■decs  on  tia  tsng.  Tne  dyna  tic  satety  mode 
ne  ps  to  _inde  "stand  the  'eaten an  p  between 
systems  desgns  ©d  numat!  performance.  Tne 
feo'Y  ot  e  aimed  Pa  our  s  jggests  tnat 

■tendon  a  a  f  jnct  on  ot  atf.tjds,  social  norms 
©d  perceved  behavioural  canto  .  Tne 
nat  ori-stc  decs  on  nek  ng  p©adgm  pos  its  that 
decs  ora  -we  based  on  a  wider  vew  of  mudpie 
pat -©ts,  ©epetse,  syst™ns  ocHupexty, 
Penwoiira-  mtento  n ,  ndvdual  be  eta  and 
Ciinent  understa  ndmq  ot  tne  system . 
dnde -stand  mg  and  predicting  oenavotra  safety 
decs  ana  coad  ne  p  ja  to  encourage  comp^©OE 
to  cunent  poesaes  and  to  da  p  Cette" 
nte-ventons. 

INTRODUCTION 

Studies  frequently  demonstrate  a  differ¬ 
ence  between  tarepinJ  policy,  w  hut  cl  ini - 
d am  report  happens,,  and  whit  ictially 
hipptns.1  "  Evtcy  day  diniciins  must 
■LUsridt  up4>n  tlitf  hevt  safety ,‘tf  he  icncy 
tradeoff  that  they  think  will  achieve  the 
bed  cite  for  their  patients/  Sometimes 
those-  decisions  ire  made  in  dynamic, 
ti me -pressured  environments  where  dint- 
dans  revert  to  what  they  know  rather 
than  following,  an  analytical  step-by-step 


process."  Violaridns  and  non-adherence 
therefore  are  common  not  always  con¬ 
scious.  not  always  planned,  are  frequently 
well  meaning,  and  in  many  cases  allow 
the  system  to  run  smoothly*  Thus, 
simply  hi  a  mini;  violations  ot  satep-  p  r<k:e- 
dures  on  ‘neglitfent1  m  ‘ditficult’  clini¬ 
cians  belies  the  complexity  ot  decisions 
about  safety  prihressea  Safety  is  ultim¬ 
ately  delivered  by  peop le — patients,  their 
i  ami  I  ies,  non-clinical  workers  and  espe¬ 
cially  clinicians — not  pidicies,  pnx:esse^ 
or  checklists.  Thus,,  the  relationship 
hetween  whs  clinicians  should  do,  what 
they  think  they  do,,  and  what  they  actu¬ 
ally  do  may  tell  u>  how  behaviours  are 
created  by  the  decisions  that  clinicians 
make,  based  on  the  systems  that  surround 
them  and  the  constraints  of  the  origin  Na¬ 
tion.  A  met hthi  erf  undemanding  and 
predicting  behavioural  safety  decisions 
could  help  lls  to  encourage  compliance  to 
current  processes,  and  to  design  better 
future  interventions. 

COMPLIANCE  AND  VIOLATIONS  IN 
COMPLEX  SYSTEMS 

Patient  safety  research  initially  ft  reused  On 
understanding  the  true  extent  and  sources 
of  errors,  typified  by  case-note  review7 
direct  observation  stLhdesK  arvl  implemen- 
tation  of  basic  quality  imprtrvement 
ri’Jem-..  ^  w  Eventually  thi-.  mift-ed  towardi. 
quantitative  methodologies,11  1_  the  propr- 
ositi-jn  of  then  metical  models,1  and 
more  recent  lyt  several  major  evidence- bused 
safety  innovatit^ns.1  ’  1  Reliable  implemen- 
latifun  of  these  new  ways  of  working  has 
been  nuNre  dithcult  A'ii^lad-ons — tai lures  to 
follow  rules,  prtkrjaes  and  guidelines — are 
still  frequent  and  quality'  improvements  are 
not  always  apparent1  K  Compliance  to  hand 
hygiene  protocols  may  he  observed  1 *  low 
as  2%  in  the  operating  room1H:,  nack  dis¬ 
cipline  can  be  extremely  variable31;,  equip¬ 
ment  counts  can  be  disruptive  and 
ineffective"1  —  ^  des-t  ran  ions  are  frequent-5; 
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d eep  vein  thrombosis  prophylaxis  is  notoriously  vari¬ 
able"1  "1  checklists  and  timeouts  may  he-  used  sporadic¬ 
ally;'1*  with  considerable  variation  in,  their  uptake."' 
Though  the  reader  is  directed  towards  detailed  consid¬ 
erations  of  error  and  violations, five  types  of  viola¬ 
tion  ate  often  discussed: 

►  crxinosiis  violiiiioiH — due  to  a  lack  of  uodgrtaniliif  or 
inapt  hence; 

n-  cxccptkinaJ  vidaxuns — when  unusual  dfoimaanccs 
require  an  unusual  response  j 

►  situational  violations — when  the  environment  makes 
adherence  difficult: 

►  routine  violations — when  a  shortcut  is  taken  regularly; 

►  optimising  violations — w  hen  there  is  a  desire  to  improve 
a  work  skuation. 

Rather  than  being  deliberate  negligence  or  poor 
practice,  work  in  other  industries  illustrates  that  rules 
and  priced ures  constitute  fragile  safety  harriers,  and 
violations  usually  reflect  good  intentions  to  complete 
work  efficiently;  even  if  the  behaviours  are  eventually 
misguided  and  unsafe.  Thus,  the  apparent  simplicity 
of  safer  processes  belies  the  complexity  of  their  imple¬ 
mentation  within  the  healthcare  system. 1-1 

Quest  ions  of  safety  must  he  framed  within  an  under¬ 
standing  of  the  relationship  between  people  and 
systems  of  work.  Errors  are  frequent,  accidents 
normal,"'"  and  are  predisptised  by  deficiencies  within 
systems  which  may  promote  the  wrong  behaviours  and 
al low  errors  to  perpetuate  to  catastrophe*  Indeed 
rather  than  being  a  hazard,  people  create  safety  in 
complex  systems  by  providing  the  flexibility  to  func¬ 
tion,  despite  the  risks  of  errors  in  an  uncertain,  time- 
pressured  resource-constrained  world.4  Under  financial 
and  wor  k  load  pressures,  accepted  ways  of  working  can 
migrate  toward  unsafe  boundaries"”  through  shortcuts 
and  lowered  accepted  iandaxds.  Efficiency  and 
t  hroug  hput  issues  can  create  di  f  f icult  wor  king  environ¬ 
ments,'  where  manager  and  clinician,  dash  over  the 
need  to  trade  organisational  goals  (eg,  efficiency)  for 
safety  goals  for  individual  patients.  New  processes  or 
checks  need  to  he  trained  and  implemented,  which  can 
add  time,  financial  and  managerial  pressures  to  the 
system,  with  the  monitoring  of  these  requirements 
further  increasing  overhead  cost."  Effective  imple¬ 
mentation  processes  incorporate  hands-on  leadership, 
front  I  i  ne  decision  making  dedicated  resources,  local 
modification  and  feedback."'^  Sometimes,  the  imple- 
mentation  of  guidelines  is  hindered  by  organisational 
constraints.'^*  Sometimes  people  are  si  mply  unaware  of 
their  deviations.""  Thus,  in  the  same  way  that  errors 
cannot  necessarily  be  avoided  through  ‘trying  harder1, 
seeing  violations  of  safety  processes  as  purely  due  to 
individual  will  does  not  account  for  the  systemic  pres¬ 
sures  upon  t  he  i  ndiv  i duals  de  I  iveri  ng  care. 

SYSTEMS  MODELS  OF  COMPLIANCE 

A  range  of  mthielsanl  techniques  are  available  to  help 
us  understand  how  t  he  systems  of  work  affect  behaviour. 


The  syston  of  surgery  has  been  examined  in  detail  by 
sevoal  groups  who  have  been  able  to  observe  the  effects 
on  behaviour  and  operative  course  of  different  config- 
uratkns,  specialties,  distract  it  ms,  disruptions  and  unin- 
tenrional  outcomes,3  3  32  14  30  x  These  interactions  can 
be  complex'^  but  demonstrably  infben.ee  outcomes." 
Models  exk  for  describing  the  complex  relationship 
between  systems  components1'^  4,J  41  hut  generally  they 
ackntw ledge  that  people,  tasks,  equipment  tiwuls  and 
aspects  of  the  organisdion  all  interact  to  produce  either 
aiccesshil  or  unsuccessful  processes.  From  an  organisa¬ 
tional  perspective,  the  dynamic  safety  rmxLel :'1  provides 
a  framework  examining  organisational  tendencies 
toward  or  away  from  unacceptable  workload,  economic 
failure  and  safety;  thus  a  flowing  the  qualitative  consider¬ 
ation  and  potential  quantification  of  high-level  organisa¬ 
tional  issues. 

Systemic  predisposition  to  error — that  k,  how- 
workplaces  can  create  the  Opportunity  for  people  to 
make  and  perpetuate  mistakes — needs  to  he  mediated 
by  an.  understanding  of  individual  behaviour  and 
responsibil  ity.  A  systematic  review  of  violations  across 
a  range  of  industries  (including,  hut  not  limited  to, 
healthcare)  suggests  worker -cent red  design,,  training, 
competing  goals  and  rule  definition,  as  predictors  as 
well  as  individual  characteristics.4"  For  example,  in 
medication  admi n istrat ion.  violations  may  he  influ¬ 
enced  by  context,  process  and  hospital  location.4  ' 
Anaest  hesiokigists1  decisions  to  follow  or  deviate  from 
guidelines  are  influenced  by  the  beliefs  they  hold 
about  the  consequences  of  their  actions,  the  direct  or 
indirect  influence  of  others*  and  the  presence  of 
factors  that  encourage  or  facilitate  particular  courses 
of  action. 1 L  Compliance  can  he  observably  influenced 
by  case  complexity  and  job  pressure.45  Despite  the 
focus  on  an  evidence  base,  a  sy dermatic  review  of  the 
use  of  guidelines  finds  that  flexibility  of  recommenda¬ 
tions  to  ks:al  context  and  concise  recommendations 
are  also  important  aspects  of  adherence.4*  Systemic 
ambiguities  which  discourage  a  clear  understanding  of 
how  things  'should1  work  may  be  particularly  useful 
in  understanding  healthcare  violations. l'' 

BEHAVIOURAL  MODELS  OF  COMPLIANCE 

Improving  safety  is  also  about  achieving  behavioural 
change,  which  is  influenced  by  knowledge,  beliefs., 
decision  priKresses,  context  and  social  influences. Ll'  In 
bet,  the  use  of  procedures  and  processes  may  be 
viewed  as  counteracting  the  use  of  expertise  and 
common  sense,4"1  and  thus  senior  daff  can  often  be 
the  trigger  for  violation  that  leads  to  a  migration 
within  the  system  as  a  whole.4'7  Indeed,  even  excep¬ 
tional  violations  can  eventually  become  accepted  prac¬ 
tice.  Rule  violations  may  also  give  the  violators  an 
impression  of  power."'"  This  is  reflected  in  the  differ¬ 
ent  attitudes  to  rules  that  doctors  and  nurses  share,51 
and  in  the  cognitive  dissonance  apparent  in  the 
responses  of  surgeons  to  the  surgical  safety  checklist. 
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with  a  higher  proportion  slating  they  would  like  the 
checklist  used  during  their  care  than  believed  it 
improved  safety  improved  communication  and  pre¬ 
vented  errors, 5  The  challenge  is  to  encourage  clini¬ 
cians  to  make  the  right  decisions  that  protect  each 
patient  they  are  tor,  above  the  financial,  social  and 
workload  pressures  from  the  higher  echelons  of  the 
organisation,  their  peers,  legal  systems  and  even  pro¬ 
fessional  organisations. 

At  the  'sharp  end1  of  the  organisation,  possibly  the 
mod  influential  theory  in  health  psychology  for 
understanding  individual  behavioural  intention  has 
been  the  theory  of  planned  behaviour'  "  In  addition 
to  generic  health- related  behaviours  such  as  smoking, 
drug  taking  and  dieting/4  it  has  been  applied  to  hand 
hygiene  prediction  '  and  venip uncutre. 5  In  its  sim¬ 
ples  form,  the  theory  can  be  expressed  as  the  math- 
emdical  function  in  bos  1.  This  has  been  the  basis  tor 
the  Technology  Acceptance  Model,'7'  which  is  not 
without  its  critics,'7 but  illustrates  how;  with  sufficient 
understanding,  compliance  and  violation  might  be 
modelled.  If  we  consider  some  broad  anahigies — 
when  perceived  behavioural  control  might  relate  to 
implementation  princesses  and  organisational  pres¬ 
sures;  social  norms  might  be  examined  through  team¬ 
work  and  concepts  of  professional  standards;  and 
attitudes  might  be  measured  through  consideration  of 
evidence  bases,  prior  experience  and  knowledge — 
then  it  may  be  possible  to  build  a  model  of  how  the 
nature  of  change,  systems  design,  and  individual  and 
professional  i nf  I uences  can  lead  to  violation  decisions. 
However*  the  precise  parameters,  the  nature  of  the 
model  and  their  relationship  would  need  to  be 
defined  through  observation  and  experi  mentation. 

NATURALISTIC  DECISION  MAKING 

Compliance  is  a  classic  systems  problem,  with  initial 
violations  predisposed  to  at  the  organisational  or  man¬ 
agerial  level,  and  perpetuated  through  a  range  of 
measurable  sodo- technical  parameters.  The  naturalis¬ 
tic  decision  making  paradigm.'7^  helps  us  to  understand 
how  human  decision  making  is  mediated  by  this 


Bax  1  Theory  of  plamed  behaviour  ex  pressed  as  a 
testable  model 


Behavioural  intention-  P’lA  B|ib  +e][+(W3}S N  [n+m]  ^W3) 
PBCk-Hpl 

AB:  attitude  toward  behaviour  |(b}:  strength  of  each 
belief +{e):  evakiat  ion  of  the  outco  me  or  attribute) 

5N:  social  form  |{n}:  strength  of  each  normatiw  belief 
+{m}:  motivation  to  compiy  with  the  referent] 

PBC:  perceived  behavioural  control  |(cj:  strength  of 
control  belief -Kp}:  perceived  power  of  control  factor! 

W:  empirically' derived  tveight/co efficient 


organisational  and  environmental  context  It  posits 
that  decisions  are  usually  made  in  uncertainty:  under 
time  pressure,  with  ill -defined  goals,  and  are  based  cm 
expertise,  pattern  matching  or  recognition  of  a  given 
situation,  and  are  thus  nonlinear,  non- analytical  and 
not  necessarily  logical^  rational,  or  based  on  risk/ 
benefit  considerations*  Naturalistic  decision  making 
has  been  extremely  influential  in  the  human  factors 
science  of  decision  making  especially  to  underhand 
and  improve  tactical  decisions  in  military  operations/1'1 
and  is  beginning  to  be  used  in  healthcare. 

Direct  observation  in  the  emergency  department 
(ED)*1  found  that  only  about  45%  of  the  decisions 
were  planned,  with  the  rest  being  opportunistic  cur 
forced  fay  interruptions*  Moreover,  decisions  were  nert 
hei  ng  made  about  i  ndiv  idual  pat  ients  alone*  hut  t  heir 
care  within  the  wider  view  of  the  ED  as  a  whole,  and 
situational  factors  that  defined  the  IcKral,  immediate 
demands  for  resources.  Indeed,  these  different  goal- 
directed  behaviours  can  have  an  interfering  influence 
on  the  performance  of  evidence-based  behaviour/2 
Thus,  it  is  becoming  apparent  in  healthcare  systems, 
as  in  other  indu&ries,  that  the  decision  to  adhere  to 
guidelines,  princesses  or  safety  procedures  is  not  neces¬ 
sarily  logical,  linear  and  evidence  based,  hut  based  cm 
a  wider  view  of  multiple  patients,  expertise,  sytfems 
complexity;  behavioural  intention,  individual  be  I  iefs 
and  current  understanding  of  the  system. 

SUM  MARY 

Behavioural  change  and  violation  reduction  are  key- 
dones  of  the  safety  movement,  but  the  mechanisms 
have  been  infrequently  described  and  even  less  fre¬ 
quently  quantified,  ft  is  in  the  quantification  that  we 
may  he  able  to  achieve  robust  scientific  evidence,  and 
a  greater  ability  to  predict  and  balance  throughput, 
cod  and  safety.  Though  a  great  many  approaches  to 
human  decision  making  and  violations  exist,  the 
rmsdels  selected  here  lake  different  hut  complimentary 
perspectives.  The  Systems  Fngineering  Initiative  for 
Patient  Safety  (SEIPS)  model  examines  the  broad 
influences  of  behaviour  upon  systems,  and  lends  itself 
to  multi -parameter  measurement  through  direct  obser¬ 
vation/'  but  may  not  directly  address  or  predict  indi¬ 
vidual  behavioural  outcomes*  It  might  t  here  fore 
provide  a  useful  way  to  quantify  the  context  of  a 
work  system.  The  theory  of  planned  behaviour  and 
the  technology  acceptance  mihiel  is  quantifiable  from 
a  behavioural  approach,  hut  may  he  oversimplisti- 
C5Sand  does  not  address  the  broad  array  of  behav¬ 
ioural  determinants  of  SKIPS.  Finally:  the  dynamic 
safety  model  and  naturalistic  decision  making  para¬ 
digm,  though  largely  qualitative,  make  the  Jinks 
between  system  and  person,  directly  acknowledging 
the  systemic  tradeoffs  between  safety  and  efficiency 
that  need  to  be  made  every  day  They  may  t  here  fore 
provide  a  framework  in  which  systems  context  and 
individual  behaviour  might  be  brought  together  in  a 
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q  lli  rvti  blab  k  form .  W  heth  cr  th  at  is  possib  k  rc-miiirs  m 
be  h?ctl  Clearly  t  hi-i-  is  a  complex  challenge. 

Within  a  framework  that  recognises  he-hivioury  ir  ite 
from  systems  of  wor k. 1 organisations  are  under  a 
range  of  p reran  res, ? 4  and  That  decisions  need  to  be 
understood  from  a  naturalistic  point  of  view.':'J  it  is 
possible  to  explore  these  rdationsh ips  from  a  quanti¬ 
tative  and  qualitative  perspective.  The  immediate 
utility  would  be  in  developing  quantitative  models 
that  describe  the  influence  of  organisation*  context 
tasks  and  tools  on  systems  safety  behaviour.  The 
longer-term  benefit  would  be  in  understanding  the 
mechanisms  of  safety  change  and  the  prediction  of 
successful  or  unsuccessful  interventions.  This  would 
provide  a  better  understanding  of  how  we  can 
improve  the  safety  of  patients  within  complex  and 
increasingly  pressured  healthcare  organisations.  It  may 
he  the  piece  of  the  puzzle  we  are  missing. 
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ABSTRACT 

Backg  mu  nd  Mods'  n  caTe  requ  res 

■noTera  us  parent  handews^han dofta  Handout 
ero^  s  'eoognsed  as  a  potenta  haza'd  n 
patent  eje,  and  the  ^nto  proton  emr  rate  has 
been  est  rated  at  1 3% .  Wh  e  acc j  rate,  re  abe 
nandore:  is  ese.nt  a  to  rrg  h  qua-ty  care, 
uncertainty  exits  as  to  how  utrafiasprta 
ha  ndo re.r  can  be  itp^oved.  Ths  systematc 
rev  ew  a-'Trs  to  eva  ruate  the  effect  sveness  of 
uterrent  ons  a  ’red  at  tp  rcvng  the  qja  ty  a  nd/ 
a?  safety  at  the  ntrenoai  la  handewer  p  aoesi 
Methods  Wfc  searched  toe  alee  on  bandore* 
r  pFcwer  ent  HtewentEFis  in  EMBA5E. 

MEDLINE.  HMIC  and  CINA HI  uetween  January 
2002  a  nd  Jay  201 2.  We  ao  ne  dered  st  odes  at: 
staff  Knowledge  a  nd  sifl fe,  staff  bsnw  ou"2 
mange,  p^ocss  change  c*  patient  outocFres. 
Resu  fts  031  patent  a  y  re  eva  nt  papers  we-e 
dent  f  ed  for  wn  di  29  pape-s  were  seected  for 
no  jseffi  ; two  ra  ndor  eed  cant'd  ed  tria  s  a  nd  27 
uncant  ro,!ed  st  odes! .  Most  st  odes  addressed 
sn  tr-cna  nge  na  ndorer  and  used  a  mad  an  at 
lures  o  utcome  r”easuresJ,  but  thefe  was  no 
outcome  ’Tjeasune  CDmn-Qn  to  a  - .  Fbc*  st-jdy 
ds-gn  and  nconsstent  reccrtng  rethods  ^ade 
t  d  ffa:  u;t  to  eO  did-  n  te  oondiEons. 
Infanralan  -tarc-tei  was  Tnpcred  nrost 
re  want  studies,  wnSec  n  cal  outcome 
rp^erent  was  rep'Or1ed  n  on  y  two  of  10 
stud  es.  Wo  d  fierence  was  noted  n  the  \eA  hood 
at  ajCTE5saot5stour  tyipes  ot  nterrentcn. 
Cbndusions  Tne  cu  nent  te’-a tune  does  not 
•scntlrnr-  that  a  ny  methodology  e  anly  I  rp'ores 
1 fe  outcomes  of  dKca  ha  nd^er,  a  thoug  h 
nforraton  transfer  ™--ay  re  noeased.  Better 
study  des  gns  a  nd  oonsstency  ot  t  ne  tenr-ino-o-gy 
used  to  describe  handcfierand  ts  :r  p'ewerent 
a  e  uigenty  ’neqd^  red . 

INTRODUCTION 

Tht  practice  isE  rmsdem  rTvedicine  relies 
upiiti  inoeasin^ly  complex  work  environ¬ 
ments  arul  supporting  procesaies.  One 


pnjccss  central  Isj  the  delivery  of  sate 
care  Ls  ha  nik  >ver  Jiandtiff).  Clinical 
handover  has  heen  defined  as-  ‘the  trans¬ 
fer  of  professional  resportsdti  lily  and 
accountability  for  some  or  all  aspects  of 
Care  for  a  patient,  or  groups  ot  patients 
to  another  person  or  professional  group 
on  a  temporary  or  permanent  basis'.1 
The  publication  of  healthcare-derived 
error  reports"  '  prompted  significant 
changes  both  in  the  delivery  of  care  and 
how  clinicians  view  error.'1  Following  t he 
introduction  ot  reduced  working  hours, 
t he  n um he r  of  vhi ft  hundove rs  i n  Fui rope 
and  the  USA  has  increased  by  up  Do 
40%/  and  Itandover  between  doctors 
has  become  formalised.  Ir  has  been  esti¬ 
mated  that  an  average  inpatient  will 
require  24  handovers  during  their  hos¬ 
pital.  stay/  and  that  1.6  million  handovers 
€M.cur  in  the  USA  per  year/  The  rafety 
benefit  derived  from  shorter  working 
weeks  should  he  viewed  in  the  context  ot 
the  additional  risks  associated  with  an 
estimated  13%  error  rate  derived  from 
handover. 1 

Handover  failures  typically  contribute 
to  a  cascade  ot  failures  involved  in 
adverse  outcomes*  rather  than  heing  sole 
causes,  making  the  estimation  and  investi¬ 
gation  of  handover-derived  harms  diffi¬ 
cult.  Common  consequences  of  handover 
tailures.  such  as  near  muses  and  delays  in 
care,  are  difficult  to  ararss  for  their 
overill  Contribution  to  puteutial  harm,1' 

Eland  over  can  he  viewed  dimply  as  a 
human  interaction  where  informatiiin  is 
senL  receih  ed  and  priscessed.1 1  However* 
this  process  receives  multiple  inputs  relat¬ 
ing  to  the  core  healthcare  tasks  oh  pre¬ 
scribing;  investigation  requests;  receiving 
and  interpreting  results;  ensuring  cond  un¬ 
ity  ot  care;  and  delivery  of  padent 
adv  ice. 1 "  l'  t  is  t heretore  posable  to  nest 
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this  human- to -hum  an  interaction  within  a  wider 
system  of  work  which  requires  the  exami  rut  ion  of  the 
action  and  interaction  of  technology,  environment, 
tasks  and  the  organisation  surroimdi ng  the  handover  1 

Recognition  of  the  potential  risks  of  handover 
errors  has  led  many  researchers  to  attempt  to  improve 
it  using  a  range  of  methods,  both  simple  and  multi - 
component .  Interventions  generally  target  information 
transfer  directly:  individual  behaviour  or  the  wider 
system.  Approaches  have  included  process  standardisa¬ 
tion;  training  and  education;  changes  to  the  physical 
environment;  use  of  technology;  explicit  signalling  of 
accountability  transfer;  and  others.1  '  The  diversity  of 
met  hods:  used  to  evaluate  the  results  has  been  even 
greater,  but  can  be  grouped  as  deal  ing,  with  patient 
outcome,  staff  satisfaction*  compliance  witk  protocols, 
time  taken  for  hand-over  and  information  transfet  (eg 
comp leteness  -or  accuracy  of  information  transfer). 

Uncertainty  remains  as  to  the  most  effective  method 
for  improving  intrahisspital  handover.  This  systematic 
review  aims  to  evaluate  interventions  which  have  been 
developed  to  improve  the  quality  and;or  safety  of  the 
intiahuspital  handover  process  with  a  view  to  enabling 
hospital  practitioners  and  researchers  to  focus  On 
refining  the  most  effective  interventions, 

METHODS 

See  pe  of  rev  iew 

We  wished  to  be  inclusive  of  studies  of  attempts  to 
improve  all  types  of  handover  within  hospital  setting. 
We  the  re  fore  developed  a  search  strategy  based  on  the 
PICO  question:1*  In  [PO PULATI ON ;  groups  of  clinical 
ttflff  handing  over  informiion  about  piients  under 
their  care],  do  [INTERVENTION;  systematic  inten 
bona!  interventions]  compared  to  [COMPARISON;  no 
intervention]  improve  [OUTCOMES;  piient  outcome, 
daft  satisfaction,  time  taken  or  information  transfer]?* 
Inclusion  criteria  for  studies  comprised:  (a)  indudes  an 
intervention  developed  with  the  intent  of  improving 
handover  quality  and/or  safety  (b)  set  within  an  intra- 
hospital  environment  (e)  uses  both  preintervention  and 
pLKStintETventiori  merit  (or  any  factor  relating  to 

the  intervention)  to  evaluate  improvements  (d)  assesses 
any  of:  know  ledge  and  skills  of  staff,  time  taken  for 
handover  or  related  tasks,  staff  behavioural  change  or 
patient  outcomes. 

The  protocol  was  registered  with  an  international 
database  -of  pn&pectively  registered  systematic  rev  iews, 
FROSFERO  (legistriion  number:  CRD42012001995). 

Search  st  rat -egy 

We  searched  EM  BASE,  MEDLINE,  HM1C  and 
CINAHL  for  papers  published  in  English  between 
January  2002  and  July  2012,  using  a  search  strategy 
based  on  the  terms  below.  Synonyms  of  handover, 
inter- hospital  and  intervention  were  used  thus: 


►  HandciwrtO,  hand  ovojs),  hand-fjvaJsJ,  handofffc), 
hand  offbk  sign  outfsj,  agn  off(s),  shift  to  shift  (s),  inter 
sbi  ft  (s) 

►  Paucnt  rransferfs),  imraho&pital  rra nsfc  r(*},  inua  hospital 
irarjifcjJi),  imraho  spiral  nan on  (s),  intra  hospital  trans- 
pon  (s) 

►  Lmenemionf^,  i  mprove  (wild-card  Boolean  for  impiovc- 

nierr.im  prow:mcnts,iJinproving  cic.)s  qualky  safety, 
stra  teg  (wild -card  Boolean  for  rare  gy/a  rare  gi  e  s'snai  egi  e 
etc.),  training,  inarument  (s},  sandardi  (wild-card 

Boolean  for  sandardisaiion/standardi^aiion/sartdardisa- 
t ions  rac),  mnemonief^. 

Exclusion  criteria  and  pa  pe  r  select  ion 

The  studies  identified  in  the  searches  were 
deduplicated  and  abstracts  were  reviewed  by  one 
reviewer  for  compliance  with  inclusion  criteria.  The 
resulting  full  text  articles  were  independently 
reviewed  by  two  reviewers  in  consultation  with  a 
third.  Data  were  extracted  independently  on  to  col  lec¬ 
tion  forms  and  the  reviewers  then  met  and  compared 
responses.  If  there  were  differences  of  opinion  about 
eligibility:  these  were  resolved  by  mutual  agreement 
and  if  this  was  not  reached,  an  external  opinion  was 
sought  (PM,). 

Data  extract  k-  n  =  nd  synthes  is 

Where  available,  the  information  in  box  1  was 
extracted  from  each  paper.  The  interventions  were 
categorised  into  three  overarching  categories  of 
‘person1  interventions  ( focusi ng  on  training  people, 
improving  awareness  and  changing  culture),  ‘informa¬ 
tion  system1  interventions  (focusing  on  rationalising 
systems  of  information  delivery)  and  ‘w ide r  system1 
interventions  (focusing  on  improving  the  technology 
and  infrastructure  underlying  the  hand-over  process). 

Dual rty  assess ravent 

Assessment  of  the  quality  of  included  papers  was 
undertaken  using  a  nullified  Downs  and  Black  (DficB) 
checklist. 1  This  checklist  was  designed  to  provide  an 
evaluation  of  the  quality  of  birth  randomised  and  non- 
random  bed  studies  of  healthcare  interventions  on  the 
same  scale.  It  has  27  questions  in  three  sections  cover¬ 
ing:  reporting,  external  validity  and  internal  validity 
(bias  and  confounding)  and  has  previously  been 
adapted  for  use  with  handover  studies. 1  We  reasoned 
that  omission  of  questions  which  would  add  nothing 
to  the  final  assessment  in  the  nature  of  the  studies  we 
were  evaluating  was  legitimate.  We  therefore  consid¬ 
ered  the  original  and  handover  adapted  versions  of 
the  checklist  together,  and  adapted  them  to  produce  a 
hybrid  version  for  our  use  based  on  this  principle. 
Thb  led  us  to  exclude  seven  questions  deemed  to  be 
unsuitable  (Qj,  Q%  Q12,  Q14,  Q17,  Q25  and  Q26) 
and  three  which  required  adapt  ion  (Q4+  QS  and 
Q21).  Due  to  these  changes,  the  maximum  score  a 
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►  I2?rcfai 

-  Number  of  hospitals 
Medical  sociality  setting 
Type  of  handovers 

►  5  Vj*3y  typo 

Study  design 

-  Tiirafine  (OhsQrvatioa  iotawfition  aod 
fakw-up) 

-  Outcome  uraeasuires 

►  frtefYontion  typo 

-  Person 

Tcan^ork  training  iTwT]  classroom 
TwT  asadiiig 

-  Video  ^reflejdw  techniques 
Medical  supervision 

►  fryformation  system 

Standard  operating  proceduros  [SOP/p rotted} 
MinifT.tJF  dataset  Lind  udiriq  ■Checklists} 
Mnemonics 

►  Mlder  system 

Information  technology 
Conti  nuaus  process  improvement 

►  Ckteomes 

-  Measures  of  inforniatkin  transfer  [information 
transfer.,  error,  forgotten  tasks} 

Measures  of  satisfaction  with  the  process  (staff 
and  patient} 

Measures  of  compliance  with  the  p respecified 
protocol  for  the  handover 
Duration  {handouer  length,  time  to  treatment  and 
overtime  tequirements} 

Clinical  outcomes  [adverse  events  and  patient 
outcomes} 


studv  could  achieve  was  reduced  from  the  original  27 
to  20. 

In  a  similar  tashion.  we  adopted  a  modification  of  a 
rect!|jtiised  guideline  Ires  evaluate  intervention  transfer- 
ability.  The  Standards  for  Quality  Improvement 
Reporting  Excellence  (SQLJI RK.)  guidelines  were 
developed  in  2-009  ti>  promote  standardised  reporting 
of  healthcare  quality  improvement  interventions.1'5 
For  the  purposes  of  tills  review,,  Q 8 .  Q 9a_  Q9b.  Q9c,„ 
Q14a,  Ql-fib  and  Ql-f-ic  were  used  to  critique  the 
included  papers  on  the  reporting  ot  their  intervention. 

also  recorded  whether  there  was  a  spedfic 
men tiis n  ot  the  SQUIRE  guidelines, 

RESULTS 

A  total  of  29  studies  were  identified  tor  inclusion  in 
this  review.  The  search  ot  EMBA5E*  ME  DUNE,. 
HMK]  and  CINAI 1L  provided  a  total  of  £.11  citations 
and  following  deduplication  4.17  papers  remained 


figure  1).  Of  these,.  329  were  excluded  after  abstract 
review  as  not  marching  the  inclusion  criteria.  The  full 
rest  of  the  108  remaining  citations  was  reviewed  in 
mo  re  del  ail;  79  of  these  did  not  meet  the  inclusion  cri¬ 
teria  and  were  excl  uded.  The  remaining  29  papers  met 
t  he  i  ncl  uvio  n  cr  iter  ria  ( r  igu  rz  I )  a nd  are  dis  played  in  t  he 
sum  mar y  table  [see  im  I  ine  supple  menta ry  tabl  e  SI ). 

The  -study  derign*  of  die  included  studies  included' 
two  randomised  control  trials  (RCTTs);14  "  '  erne  pre  in¬ 
ters' entio  n-pustinte rvention  controlled  trial' _1  25  pre- 
i  nter  h  en  ti  i  m/posri  nter  vent  io  n  u ncontri  s  I  Led  L  ri  als;" "  1  f 
and  o  ne  PI  an  -E>o  C  ’ heck- Act  design. 

A  total  rtf  11  759  handovers  were  included  in 
vtudies;  which  gave  this  information*  with  a  median  of 
105  handewers  per  study  Ten  studies14  Z1  "*  1,1  :'" 

n  h  «&  no  information  on  the  number  oi 

handovers  they  included  [see  -online  supplementary 
table  51 ). 

Study  duration 

Of  those  studies  which  gave  information  on  the  length 
ot  ti  me  tor  each  study  compo  nent,  t  he  med  ian  length  of 
time  (days)  for  preintervention  data  collection  was  28 
[range  4— 224 X  fur  intervention  was  28  [ranis  1-252), 
the  gap  between  intervention  and  the  commencement 
of  postinte rvention  data  collection  was  10,5  (range  0- 
M5)  and  the  postintervention  data  collection  peri  id 
was  28  (range  4—224).  Seven  studies  gave  no  informa¬ 
tion  cm  a  ny  com  pone  nt  o  f  t  hei  r  indy  design  t  imeli  ne  ’ ' 
11  ' '  and  14  gave  no  i  n  tor  mat  ion  cm  one  or  more 
study  timeline  comport1* lT ^  255  ^ 

Study  errvi  m  n  merits 

The  majority  of  the  studies  (22)  were  performed  in 
one  ward  environ  merit'  1  Four  studies  were  per¬ 
formed  in  more  than  one  environment1  11  '''  3:1  and 
three  gave  no  detail  on  the  study  environment. 5 1 

I  mp  ravement  str  ate-gies 

The  included  Ltu-die^  took  varied  approaches  to  hand- 
ewer  improvements.  I:  if  teen  Judies  were  mono- 
dim  ponent  interventions1*  11  51  *  n  «  and 

the  remainder  contained  two  or  more  components. 
.Seven  studies  shared  an  intervention  Component:  two 
inter  ven  dons:  u  sed  the  5  Ki  N  Ot  IT  maie  mon  ic~  '  and 
five  used  the  SEAR  mnemonic  in  its  original”1  1 
or  slightly  adapted  format.  ! 

Outcome  measures 

The  studies  evaluated  their  interventions  using  a  total 
id  82  discrete  outcome  measures,  each  study  using 
between  one  and  five  measures  [median  of  three). 
5 ince  there  was  no  prior  classification  system  avail¬ 
able.  we  developed  a  simple  pragmatic  classification  to 
allow  us  to  consider  studies  with  similar  outcome 
focus  together.  Based  on  die  measures  in  die  papers 
chosen  for  inclusion,  we  chose  to  group  study 
outcome  measures,  as  relating  Us:  Information 
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Record’s  identified  through  database 
searching  (n  ±63 XU 

Records  after  dug 
{fl  * 

pi  ic-atc-s  removed 

437) 

Figure  1  PWGJMA20Q9  ttowdugram. 


tr  a  nster,  Stal  l  sati  sfactio  n.,  Handover  duratiem* 
Clinical  outcomes  3jn.il  Compliance  with  handover 
pmtdtioL  Two  studies  evaluated,  their  inter  vend  tins 
wit  h  two  o  utcome  measures;  ’ J  ' 1  six  used  th  tee; 1 '  ^ 
^  *2  '  one  study  used  tour;,"”  and  one  used  five 

outcome  measures.^  There  were  no  primary  outcome 
measures  in  mr  union  between  all  the  studies  (see 
online  supplement  an'  table  52). 

The  studies  are  presented  in  -online  supplementary 
table  S3  and  online  supplementary  appendix  by  type  of 
intervention — lit  form  atLon  system,,  person  or  wider 
system — -and  if  a  study  contained  a  component  bom 
more  than  o  ne  category,  tlie  dud  y  is  represented  tw  ice. 

Seventeen  studies  reported  a  statistical  I  y  significant 
cltangp  in  at  Least  on e  of  their  mtcome  measures."  " h 
35  *  M  ***  while  10  did  not*™  22  zs  ^  ** 

''  I  m  pro v  erne  nts  in  informat  non  transfer  were 

die  most  commonly  reported  successes^  heing  found 
i  n  mo  re  than  half  of  the  dud  ies  exam  i  ni mg  t  his. "  “ 

a.  5*  &  12  -  W  *  ^  1Ai  Mid  staff  satisfaction  was  the 
next  most  commonly  improved  in  35%  of  studies-'' 

y  .ul  ■  ■  I  i 

—a  similar  proportion  to  chisse  reporting 
improvements  in  time  taken  and  compliance  with  pro¬ 
tocols.  Of  studies  which  attempted  to  evaluate 
changes  in  patient  outcome*  only  two’-  1:1  of  101"  J1 
n  ifl  n  ai  .w  #  c  j^-p^rted  a  sigmiricant 

benefit  with  one  study  repot  dug  a  12%  decrease  in 
adverse  events  (need  for  car  diop  ulmo  nar  y 


recussitation  (C PR) ..  extracorporeal  membrane  oxy¬ 
genation  (ECMO)  and  acidosis)  ( p=<  0,001) ?5  and 
the  other  study  reporting  a  significant  reduction  in 
length  ot  day  (p  =0.047). v  There  was  no  obvious  de¬ 
ference  between  the  success  rates  of  mu  Id  and  mono¬ 
component  i  nterventions*  and  none  of  our  defined 
categories  (standardisation  tools,  team  training 
approaches  or  quality  improvement  programmes) 
seemed  to  he  clearly  associated  with  a  hetter  chance 
ot  a  pt^itive  outcome. 

T  he  re  were  two  RCTs  in  the  study  selection*  and  we 
considered  the^e  separately,  One1_!  focused  on  the  use 
of  a  computerised  reporting  system  to  speed  up  hand¬ 
over,  and  found  that  it  achieved  this  aim  without 
apparently  increasing  the  risks  of  adverse  events  or 
care  errors.,  The  method  of  randomisation  was  poorly 
■described  and  the  concealment  ot  treatment  allocation 
was  not  clear.  Although  the  senior  assessor  who  judged 
whether  clinical  errors  had  occurred  was  blinded  to 
treatment  group*  the  data  supplied  to  L hi s  clinician 
apparently  came  from  the  residents  under  study  and 
therefore  unblinded.  resulting  in  a  high  risk  of  bias. 
The  other  RCT~'  evaluated  the  benefit  of  supervisor 
feedback  cm  handover  performance  among  internal 
medicine  residents,  liut  suffered  trom  similar  defect'-  in 
randomisation  and  blinding  id  assessors.  This  study- 
reported  significant  improvement  in  compliance  with 
the  protocol  but  also  suffered  trom  a  high  risk  of  bias. 


4 


e,  KV  at  SMi  Qiht  Sf20RGl-S.  lii. Hill Zp-X}  1  3 -0023 OS 


W81XWH-1 1-1-0813 


Page  74  of  77 


Systematic  review 


The  quality  score  of  the  included  studies  according 
to  the  modified  DBcB  checklist  ranged  from  1  to  17, 
with  the  median  score  of  9,  IQ  (7.5,,  12).  There  was: 
no  statistical  difference  in  the  median  D&B  score  of 
positive  and  negative  studies  (Mann- Whitney  U  test 
P=0,24S]l 

DISCUSSION 

Our  findings  in  context 

Wt  embarked  on  this  review  from  the  viewpoint  that 
handover  is  important,  frequently  the  focus  for 
improvement  studies  and  difficult  to  characterise. 

Ra duxes  in  handover  can  produce  a  wide  variety  of 
untoward  outcomes  ranging  from  lack  of  event  aware  - 
ness,  to  loss  of  significance,  and  to  dropping  or 
lacking  information  required  to  perform  tasks.  '  In 
medicine,  the  serious  consequences  which  can  ensue 
are  well  re  cognised  +  as  is  the  disparate  and  unsatisfac¬ 
tory  nature  of  handover  processes  in  many  settings. 
This  explains  the  large  number  of  studies  devoted  to 
improving  handover  proccmes.  Unfortunately,  this 
review  s hows  that  the  poor  quality  of  most  studies 
leaves  us  unable  to  draw  many  firm  conclusions  about 
bow  handover  may  be  «optimised.  We  found  that  the 
large  majority  of  published  studies  are  small,  uncon¬ 
trolled,  un-blinded  be  fo  re/after  comparisons,  and 
often  with  a  short  or  undefined  follow-up  period. 
The  only  outcome  category  which  was  apparently 
improved  in  more  than  50%  of  studies  which  looked 
at  it  was  information  transfer.  Time  taken  for  the 
process,  compliance  with  protocol  and  staff  satisfac¬ 
tion  were  all  i mp roved  in  a  minority  of  studies,  while 
clinical  outcome  improvements  were  reported  in  only 
two  of  10  studies.  This  does  not  exclude  the  possibil¬ 
ity  that  the  positive  finding;  in  some  of  these  studios 
were  valid,  but  the  lack  out  strong  t rends  and  the  poor 
study  designs  mean  that  we  cannort  have  much  confi¬ 
dence  in  this.  At  present,  it  appears  that  information 
transfer  is  the  aspect  of  handover  in  which  interven¬ 
tions  most  readily  show  change:,  whether  this  results 
in  any  beneficial  outcomes  beyond  better  recording  of 
olata  is  however  unclear. 

Infurmati-Dn  transfer 

It  seems  rational  to  use  information  transfer  as  a  key 
outcome  measure  for  evaluating  handover  since  reli¬ 
able  transfer  of  informa  turn  is  the  principal  purpose 
of  formal  handover.  However,  we  need  to  consider 
carefully  what  we  wish  to  know  about  information 
transfer  in  order  to  measure  it  effectively.  suggest 
that  the  functional  value  of  a  handover  session  can  be 
effectively  measured  by  evaluating  three  aspects  of 
information  transfer — completeness,  accuracy  and 
organisation.  The  last  of  these  is  essential  to  ensure 
that  the  most  important  data  are  not  obscured  by- 
other  items  and  are  easy  to  identify  because  the  infor¬ 
mation  is  presented  in  a  st  ructured  way.  However,  we 
recognise  that  other  taxonomies  for  describing 


information  transfer  may  also  be  valid,  for  example, 
that  proposed  by  Patterson  and  Wears'^'  or  by 
Fbzaolesi  et  d/71  and  that  ultimately  empirical  trials 
will  determine  whether  our  suggestion  proves  the 
most  useful . 

The  need  for  a  taxonomy 

Another  major  problem  identified  by  the  review  is  the 
lack  of  any  common  language  or  taxonomy  for 
describing  or  classifying  handovers,  improvement 
methods  dr  types  of  outcome.  Other  fields  of  study 
have  found  this  a  major  handicap  to  progress '  and 
we  therefore  recommend  that  attempts  are  made  to 
harmonise  terminology  and  definitions.  This  would 
greatly  assist  others  trying  to  repeat  the  work. 
However,  the  problem  is  the  great  heterogeneity  of 
handover  setting;  and  types  which  exist  in  healthcare. 
To  develop  a  taxonomy  which  can  adequately  describe 
all  of  these  is  challenging  and  arguably  to  consider 
them  all  together  as  we  have  done  may  be  inappropri 
ate,  depending  on  the  question  posed.  If  an  agreed 
taxonomy  existed,  it  would  have  helped  us  to  make 
more  sense  of  the  literature  by  allowing  us  to  identify 
whether  there  were  subgroups  where  the  literature 
findings  allowed  us  to  hypothesise  (and  the  data  avail¬ 
able  would  allow  no  more  than  this)  that  certain  inter¬ 
vention  types  were  particularly  valuable. 

We  nevertheless  suggest  that  handovers  themselves 
require  a  template  for  describing  them  which  covers 
setting,  personnel,  means  of  information  transfer, 
standardisation  of  procedure,  feedback  and  summar¬ 
isation,  task  allocation  and  recording  We  have  used  a 
four-category  classification  to  divide  the  approaches 
to  improvement  reported  in  the  studies  we  found,  but 
feel  further  improvements  to  this  could  be  made. 
However,  for  the  present  we  recommend  the  classifi¬ 
cation  of  outcomes  into  measures  of  staff  satisfaction, 
information  transfer  protocol  compliance  and  clinical 
outcome.  Not  only  did  this  deal  with  all  the  papers  in 
the  current  study  in  a  satisfactory  manner,  hut  it  lends 
itself  readily  to  analysis  of  the  data  using  the 
Kirkpatrick  four  level  evaluation  mixlel  for  training 
and  educational  interventions,12 

Need  for  imprwed  study  design  and  reporting  standards 

The  evidence  we  found  in  this  review  has  to  be 
regarded  as  very  unreliable  because  the  studies  were 
of  poor  design  and  therefore  susceptible  to  bias  from 
multiple  sources.  This  was  reflected  in  the  low  scores 
on  the  minified  DficB  scale  used.  Secular  trends  may 
give  a  false  impression  of  improvement  caused  by 
interventions;,  observers  may  find  it  very  difficult  to 
avoid  bias  in  assessing  subjective  endpoints'  and  short 
follow-up  periods  can  give  an  unrealistic  impression 
of  impact  if  they  capture  a  fleeting  improvement  in 
performance  which  quickly  fades.  The  two  rando¬ 
mised  studies1"8  "  should  be  less  susceptible  to  bias 
but  their  unusual  design,  the  Lack  id  clinically  relevant 
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emlpoiriLs  and  the  lack  of  true  Minding  decrease  their 
internal  validity  significantly.  Generally  speaking,  the 
transferability  of  the  studies  in  this  review  was  a  Isis 
low,  as  reflected  in  the  scoring  using  the  SQUIRE 
gui  del  tries. 

Limitations 

The  limitations  of  our  own  study  were  partly  a  conse¬ 
quence  of  the  problems  of  the  literature  we  studied  A 
more  comprehensive  search  not  restricted  by  lan¬ 
guage.  date  range  or  a  search  of  the  grey  literature' 
might  have  yielded  further  studies,  hut  it  seems 
unlikely  that  this  would  have  improved  the  overall 
quality  or  reduced  the  heterogeneity  of  the  studies. 
An  example  of  the  heterogeneity  was  the  duration  of 
the  study  periods,,  which  varied  hy  a  factor  of  at  least 
50  for  each  component  of  the  study.  These  two 
aspect:  of  the  literature,  heterogeneity  and  poor 
quality,  were  the  principal  causes  of  our  inability  to 
reach  strong  conclusions.  Our  initial  hypothesis  was 
very  broad.,  and  perhaps  we  might  have  achieved 
more  insights  into  the  literature  had  we  focused  on  a 
smaller  and  less  heterogeneous  subgroup  of  handover 
types.  Any  such  restriction  would  of  course  have 
affected  the  applicability  of  our  findings.  \^e  felt  it 
was  important  to  assess  the  quality  of  study  design 
and  reporting  in  these  studies,  since  the  generally 
poor  level  of  scientific  rij^mr  in  these  areas  is  such  an 
important  contributor  to  the  difficulty  in  reaching 
definitive  conclusions  from  this  literature  at  present 
Ifte  used  modificatioiis  of  the  SQUIRT  and  DSrB 
checklists  to  study  transferability  and  validity,  respect¬ 
ively.  Our  modifications  were  designed  to  allow  evalu¬ 
ation  of  an  enormously  hetero .Lentous  and  often 
poorly  descrihed  group  of  studies.  Several  question  ns  in 
both  checkl  ists  were  not  appropriate  for  eval  uati  on  o,t 
studies  of  handover  of  the  types  included  in  our 
scorch,  either  because  they  were  entirely  irrelevant  or 
because  they  were  parti  illy  irrelevant  and  attempting 
to  answer  them  would  increase  rather  than  decrease 
uncertainty  in  the  evaluation  of  the  studies.  \Vt  recog¬ 
nise  that  the  truncated  evaluations  we  u ved  have  not 
been  fully  validated,,  but  we  feel  the  logic  used  in  pro 
ducing  them  means  that  they  are  more  likely  to  he 
both  valid  and  diver i mi matory  than  Lite  use  of  the  full 
versions  of  the  Uw.ds  involved.  Further  work  could 
verify  this  hypothesis;  at  present .,  we  have  to  accept 
that  our  quality  and  transtenhil  ity  assessments  should 
he  co  ruddered  w  itli  ca  utio  n. 

fee n  m  mendatio  ns 

recommend  that  future  vtudies  of  handover 
improvement  should  use  a  standardised  taxonomy  to 
describe  the  key  aspects  of  handover,  although  we  rec¬ 
ognise  flial  handovers  :ue  so  heterogeneous  that  it  is 
unlikely  tint  any  individual  study  will  need  Lis  record 
data  about  every  aspect.  include  a  proposal  for  a 
framework  on  which  such  a  template  could  he 


constructed  (see  online  supplementary  table  54)  and 
strongly  suggest  that  this  is  adopted  for  future  study 
designs;. 

\%e  strong)  y  recommend  that  the  standards  ot  study 
design  and  reporting  for  handover  intervention 
research  are  strengthened  by  adoption  of  some  basic 
desiderate  of  clinical  research.  Researcher?;  should 
consider  using  a  control  gn.su p  not  subject  to  contam- 
i nation  hy  the  intervention*  use  Narnia rd  definitions 
of  terms  to  describe  the  handover  measure  the  inter¬ 
vention  and  the  outcomes,  and  employ  blinded  obser¬ 
vers  or  hard  objective  endpoints,  as  well  as  a  realistic 
and  specified  duration  of  follow  up.  As  a  consequence 
of  this  review,  we  would  recommend  that  a  consensus 
is  reached  on  a  core  standardised  handover  assessment 
me  dual  This  would  enable  inter-intervention  com¬ 
parison  and  aid  the  development  of  a  q:  rong  evidence 
base  as  to  which  improvement  methods  ire  of  henefit. 
We  would  recommend  that  some  form  of  information 
transfer  assessment  should  he  included,  in  this  method, 
but  that  consideration  should  he  given  to  including  an 
outcome  from  each  of  the  four  categories  we  idenii- 
tied.  ^'e  would  also  recommend  that  future  interven¬ 
tional  trials  follow’  the  SQUIRE  reporting  guidelines’ 
which  would  enable  future  researchers  arid  clinicians 
to  repeat  their  finding4-  and  the  dissemination  of 
improved  safety  processes  hetween  i munitions. ''  ' 
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